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SUMMARY  OF  UNITS  MISSION 


The  Analytical  Services  Division,  to  which  this  Process  Improvement  Team  (PIT)  be¬ 
longs,  is  part  of  the  Occupational  and  Environmental  Health  Directorate,  Armstrong  Laboratory, 
headquartered  at  Brooks  AFB,  TX.  The  Analytical  Services  Division  provides  Analytical 
Chemistry  Services  in  support  of  Air  Force  Environmental  Pollution  Control  and  Occupational 
Health  Programs.  We  respond  to  over  250  base  level  customers  who  send  over  75,000  samples 
to  the  laboratory  annually.  These  occupational  and  environmental  samples  include  substances 
contained  in  air,  water,  soil,  vegetation,  hazardous  waste,  industrial  materials,  and  biologicals. 
The  laboratory  employs  55  chemists,  technicians,  and  other  support  personnel;  and  utilizes  $5-6 
million  of  complex,  sophisticated  instrumentation. 

The  Analytical  Services  Division  maintains  analysis  certification  in  43  states,  10  ERA 
Regions,  the  Center  for  Disease  Control,  and  a  private  scientific  society.  The  laboratory  must 
maintain  its  certifications  and  follow  approved  analysis  methodologies  to  meet  environmental 
and  occupational  health  requirements  placed  on  Air  Force  installations  worldwide.  The  major 
Air  Force  Commands  at  each  installation  have  civil  engineering,  bioenvironmental  engineering, 
and  environmental  management  components  that  collect  the  required  environmental  and  occupa¬ 
tional  health  samples.  They  ship  the  majority  of  these  samples  to  the  Analytical  Services  Divi¬ 
sion  for  analysis.  The  instdlations  use  the  analysis  results  to  meet  federal,  state,  and  local  re¬ 
quirements  concerning  pollution  and  health  hazards.  Failure  to  comply  with  all  of  the  require¬ 
ments  could  lead  to  mission  interruptions,  notices  of  violation,  and  fines  up  to  $25,(X)0  per  day 
per  violation. 

In  the  last  several  years,  many  factors  have  placed  an  increasing  strain  on  the  Analytical 
Services  Division.  As  environmental  and  occupational  health  requirements  grew  more  numerous 
and  demanding,  bases  were  forced  to  send  more  samples  to  the  laboratory.  The  analysis  re¬ 
quirements  for  each  sample  are  growing  more  numerous  and  complex.  Downsizing  of  the  mili¬ 
tary  has  caused  the  laboratory  to  lose  staff  and  face  budget  reductions.  New  requirements  for 
certifications,  sample  holding  times,  decreased  detection  limits,  and  new  reporting  requirements 
were  added  each  year.  Dr  Welch,  Director  of  Armstrong  Laboratory,  had  these  concerns  ex¬ 
pressed  to  him  by  headquarter  officials  from  our  customer  bases.  He  understood  the  problems 
faced  by  the  laboratory  and  strongly  supported  us.  However,  he  was  concerned  about  possible 
laboratory  failures  and  noncompliance  situations  at  the  bases  and  therefore  requested  the  initia¬ 
tion  on  the  PIT  described  in  this  application. 
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1.9  Teamwmic 

1.1  Team  pun)ose  and  membership. 

1.1. A.  This  a^lication  for  tiie  1993  ^  Force  Team  Quality  Award  describes  and 
docnments  the  activities  of  a  Total  Quality  Process  Improvement  Team  chartered  by  the 
DiiecUw  of  tlK  1.S00  person  Air  Force  Materiel  Command,  Human  Systems  Center,  Arm- 
stnmg  Laboratory  (A^C/HSC/AL),  IH*  Billy  E.  Welch,  and  by  the  Chief  of  the  Oroupa- 
tional  and  Environmental  Health  Directorate  (AL/OE),  John  C.  Mitchell. 

1.1. B.  In  response  to  customer  feedback  and  the  prospect  of  a  greatly  increasing  work 
load.  Dr  Welch  requested  his  total  quality  advisor.  Dr.  Jim  Cupello,  to  start  a  PIT  in  the 
Analytical  Services  Division  (AL/OEA)  for  the  general  purpose  of  decreasing  the  time  re¬ 
quired  to  process  analytical  samples  and  report  die  results  to  the  customer  (turnaround  time). 
To  better  define  the  PFTs  purpose  and  establish  selection  criteria  for  team  members.  Dr 
Cupello  designated  an  advance  group  consisting  of  himself,  the  Chief  of  OEA,  two  recently 
trained  TQM  Facilitators,  and  two  statistical  consultants.  For  two  months,  this  advance  group 
reviewed  data  on  the  204,588  tests  conducted  by  OEA  during  the  previous  6  months,  group¬ 
ing  the  results  by  process  step  and  analytical  function.  This  preliminary  analysis  confirmed 
diat  turnaround  time  was  indeed  in  need  of  improvement,  and  identified  specific  process  steps 
(e.g.,  receipt  of  sample,  analysis  of  sample,  mailing  results)  and  analytical  functional  areas 
(e.g.,  metals,  inorganics,  pesticides)  that  provided  tiie  greatest  opportunities  for  improvement, 
^e  advance  group  met  with  Dr  Welch  and  Mr  Mitchell  in  Jul  92  and,  after  negotiations,  a 
specific  scope  and  set  of  goals  for  the  team  were  established.  (See  Atch  l.l.B.) 

1.1. C.  During  the  Jul  92  meeting  vnth  Dr  Welch  and  Mr  Mitchell,  the  advance  group 
proposed  specific  process  steps  and  functional  areas  to  be  targeted  for  improvement,  suggest¬ 
ed  the  performance  areas  to  be  tracked  and  improved,  proposed  Team  membership,  recom¬ 
mended  a  12-month  effort,  requested  resource  support  in  a  number  of  areas,  including  profes¬ 
sional  team  training  and  a  dedicated  TQ  meeting  room,  requested  permission  to  visit  o^er 
analytical  laboratories  for  benchmarking  purposes,  and  asked  for  open  access  to  the  Director 
shoidd  (woblems  arise.  After  discussion  and  negotiation,  nearly  all  of  the  Team’s  proposals 
were  accepted,  with  some  modifications,  resulting  in  mutual  consensus  among  four  levels  of 
management 

1.1.  D.  The  Team’s  charter  (mission)  aligned  extremely  well  with  HQ  AFMC  and 
HSC  goals  and  supporting  objectives.  Most  importantly,  we  were  dedicated  to  meeting  our 
custo^r’s  needs:  our  customers  wanted  quality  analytical  services  with  rapid  turnaround 
time.  Secondly,  we  were  oriented  toward  operating  quality  installations  by  both  improving 
tile  quality  of  our  own  organization  and  by  providing  speedy  analysis  of  environmental  sam¬ 
ples,  which  effects  the  quality  of  all  Air  Force  installations.  Enabling  people  to  excel  is  the 
very  nature  of  the  TQ  approach  to  management.  HQ  AFMC  Objective  1 .3  is  to  be  our 
customers’  supplier  of  choice  by  meeting  schedule  baselines;  the  Team’s  mission  was  to 
reduce  turnaround  time  so  our  customers  could  meet  their  schedules.  HQ  AFMC  Objective 
23  is  to  enable  our  people  to  excel  through  moving  decisions  to  the  lowest  level,  expanding 
individual  re^nsibility  and  authority,  and  seeking  feedback;  the  essence  of  the  PIT  was  to 
empower  members  to  question,  challenge,  and  improve  all  analytical  business  practices.  HQ 
AFMC  Objective  4.1  and  its  HSC  supporting  objective  is  to  enhance  the  competitiveness  of 
our  operations  by  improving  throughput,  decreasing  inventory  and  operating  expense,  and 
streamlining  support  processes;  it  was  obvious  that  the  Team’s  mission  of  reducing  turnar¬ 
ound  time,  while  maintaining  quality,  was  essential  to  our  future  as  a  support  organization. 

1.1.  E.  Individuals  were  afforded  the  opportunity  to  participate  based  on  their  exper¬ 
tise  in  the  functional  areas  identified  during  the  analysis  by  the  advance  group.  Included  were 
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b(^  militaiy  and  civilian  representatives  of  varied  ranks  from  each  of  the  three  targeted  func¬ 
tional  areas  (Cortez,  Cruz,  Long),  a  representative  of  one  of  the  lab’s  major  customers 
(Garland),  and  individuals  who  were  particularly  familiar  with  laboratoiy  automation  and 
contracting  (Schwartz,  Wiley).  Also  included  were  individuals  familiar  with  Division  admin¬ 
istrative  and  management  issues  (Jehl,  D.  Thomp^n,  Thomas).  The  Team  also  included  the 
two  statisticians  (l^ller,  Oakes)  and  two  TQ  f;u;ilitators  (Engquist,  Murphy)  from  the  advance 
group,  as  well  as  administrative  support  to  record  minutes  and  track  time  during  weekly 
meetings  (L  Thompson).  Final  team  membership  was  negotiated  between  the  process  owner 
and  the  advance  group  in  Jul.  After  team  training,  the  Team  began  work  in  Aug  92.  (See 
Atch  1.1.E) 


1.2.  Group  Dynamics  and  Documentation 

1.2.  A.  SnKioth  and  effective  team  dynamics  were  greatly  enhanced  by  a  week  of 
intensive  on-site  training  on  TQM  PIT  development  that  was  conducted  by  professional  TQM 
teachers  from  Change  Navigators,  Inc.  of  Loveland,  CO.  This  training  not  only  instructed 
the  team  on  the  use  of  numerous  effective  tools,  but  also  instilled  a  sense  of  camaraderie.  A 
particularly  useful  product  that  resulted  from  this  training  was  our  Code  of  Conduct,  which 
later  prov^  critical  to  our  success  as  a  team.  This  Code  included  such  statements  as  "during 
team  operations,  all  members  will  be  considered  equal,  on  a  first  name  basis,  regardless  of 
rank",  that  "new  ideas  are  expected",  and  that  "ideas  can  be  criticized,  but  not  people".  The 
Code  was  placed  on  the  wall  of  the  meeting  room  so  any  member  could  refer  to  it  when 
necessary.  Team  dynamics  were  also  helped  by  the  presence  of  a  facilitator  at  each  meeting, 
however  our  Team  learned  to  work  so  well  together  that  the  need  for  formal  facilitation 
decreased  steadily  over  the  one  year  life  of  the  Team. 

1.2. B.  The  synergy  generated  by  everyone’s  participation  in  the  Team  greatly  facili¬ 
tated  the  understanding  of  the  laboratoiy  processes  and  related  problems.  Since  no  one  person 
was  familiar  with  every  aspect  of  the  laboratory’s  functioning,  there  were  always  questions  by 
some  and  answers  by  others,  which  led  to  an  increased  clarity  of  thought  and  to  new  ideas. 
This  interaction  led  to  fresh  perspectives  for  area  experts  as  well  as  created  a  better  under¬ 
standing  for  those  who  were  not  as  familiar  with  a  given  area.  For  example,  the  use  of  Brain- 
stoiming  wd  Affinity  Diagrams  allowed  eve^one  to  put  forth  their  creative  ideas  and  then, 
by  clustering,  expanding,  and  further  discussion,  arrive  at  truly  team  ideas  and  solutions  that 
would  not  have  occurred  to  any  team  member  alone. 

1.2. C.  To  ensure  effective  progress  toward  our  purpose,  a  milestone  chart  was  devel¬ 
oped.  The  Team  also  followed  the  Armstrong  Laboratory  14  Step  Method  for  Continuous 
Improvement  Manual  as  a  guide  for  its  development  Furthermore,  agendas  were  provided 
prior  to  each  meeting,  thereby  allowing  members  to  come  prepared  and  greatly  increasing 
meeting  efficiency  and  focus.  (See  Atch  1 .2.C.) 

1.2. D.  Roles  of  our  team  members  fell  into  six  main  categories.  The  facilitators  kept 
the  group  focused  on  the  TQ  process  and  introduced  and  supervised  our  use  of  appropriate 
TQ  tools.  Members  from  target  areas  brought  their  specific  expertise  and  experience  to  the 
group,  and  the  customer  member  presented  the  AF  user  and  base  level  perspective.  The 
recoirier  was  able  to  capture  ^d  record  group  ideas.  The  team  leader  provided  the  manage- 
iMnt  perspective  and  our  statisticians  and  computer  programmers  provided  expert  data  analy¬ 
sis  and  perspective  on  automation.  However,  in  addition  to  their  main  roles,  all  members 
contributed  on  all  topics. 

1.2. E  The  Team  documented  its  progress  weekly  through  meeting  critiques  and  de¬ 
tailed  minutes.  A  storyboard  was  developed  in  the  OEA  work  area  and  later  placed  in  the 
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lobby  of  die  AL  ccmimand  tniilding  so  that  others  might  follow  the  activities  of  the  PIT. 
Ftiimernioce,  qmrteriy  progress  briefings  were  given  to  the  Quality  Council  headed  by  Maj 
Gen  Anderson,  HSC 

2,  Process  Sdection  Criteria 

2.1.  The  Ibam  identified  both  external  and  internal  customers.  The  external  customers 
included  all  the  AF-wide  organizations  that  collect  environmental  and  occupational  samples 
and  submit  them  to  AL/OEA  for  analysis.  We  identified  these  customers  through  a  historical 
address  listing  and  found  that  630  installations  had  submitted  samples  to  OEA.  We  then 
grouped  our  customers  into  Bioenvironmental  Engineers,  Civil  Engineers,  other  DoD  groups, 
and  Federal,  State,  and  local  regulatory  agencies.  Internal  customers  included  other  divisions 
in  the  OE  directorate,  which  account  for  10%  of  our  analytical  work.  We  also  considered 
that  in  every  process  we  evaluated,  there  were  internal  customers  within  the  OEA  division. 
For  example,  the  chemists  were  customers  of  people  who  receive  samples,  and  the  data  entry 
persoiuiel  were  customers  of  the  chemists.  (See  Atch  2.1.) 

2.2.  Identify  the  customer*s  kev  result  areas  (KRAs). 

2.2.  A.  We  used  the  expertise  and  experience  of  our  customer  team  member  and  a 
prioritization  matrix  developed  with  senior  MAJCOM  customers  to  identify  the  customer’s 
key  result  areas  (KRAs).  The  Directorate  sent  a  detailed  questionnaire  to  key  customers  to 
determine  KRAs  as  part  of  a  separate  activity  in  Nov  92.  Then  many  of  those  customers  met 
at  Brooks  AFB  and  completed  a  matrix  of  factors  that,  in  part,  described  what  they  needed 
most  from  a  support  laboratory.  Fifteen  factors  were  rank^  and  weighted.  These  factors 
included  accuracy  and  quality,  rapid  turnaround  for  special  samples,  chain-of-custody  pro¬ 
cedures,  access  to  the  status  of  samples,  certification,  etc.  Further  discussion  and  customer’s 
comments  led  to  a  prioritization  of  customer  desires.  The  Team’s  customer  member  provided 
further  feedback  at  weekly  meetings.  A  KRA  of  all  analytical  customers  was  fast  turnaround 
time,  and  this  was  certainly  the  prime  KRA  on  which  a  problem  was  perceived.  Customer 
rankings  dovetailed  with  the  conclusions  of  the  early  data  review  by  the  advance  group  and 
customer  comments  we  had  received  in  the  past  (See  Atch  2.2.  A.) 

2.2. B.  Our  action,  based  on  customer  response,  was  to  continue  with  the  course  of 
our  charter  to  focus  on  reducing  turnaround  time  and  increasing  capacity. 

2.2. C.  The  Team^s  actions  have  had  a  direct  impact  on  several  of  the  customer’s 
KRAs.  We  greatly  improved  turnaround  time  and  capacity,  as  described  in  the  results.  The 
customers  now  has  faster  access  to  the  status  of  their  samples  through  early  electronic  mail. 
’The  spirit  of  change  and  customer  focus,  fostered  by  the  Team,  has  resulted  in  spinoffs  in 
mote  rapid  customer  service,  improved  handling  of  special  samples,  and  increased  laboratory 
automation. 

2.3.  Focus  on  customer  satisfaction. 

2.3.  A.  Prior  to  the  start  of  the  PIT,  informal  customer  communication  indicated  that 
faster  turnaround  time  was  desired.  At  the  .Air  Force-Wide  Laboratory  Consolidation  Meet¬ 
ing,  a  survey  was  taken  on  customer  satisfaction  utilizing  a  Multivoting  technique.  A  list  of 
the  top  seven  issues  was  generated  in  decreasing  order  of  interest.  Later,  when  the  Team 
began  to  implement  changes,  customer  satisfaction  was  assessed  by  requesting  comments  on 
initial  electronic  mail  trials  and  coiuolidated  results  letters  as  well  as  issuing  customer  survey 
forms.  (See  Atch  2.3.A.) 
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2.3. B.  Our  initial  conclusion  was  that  to  improve  customer  satisfaction,  quicker  tur¬ 
naround  times  were  needed.  Later  we  concluded  from  the  comments  on  the  electronic  mail 
trials  that  customers  loved  the  immediate  access  to  results. 

2.3. C.  The  PIT  adopted  improvement  in  analysis  turnaround  time  as  its  top  priority. 
To  keep  the  customers  involved  and  to  ensure  effective  feedback,  communications  with 
customers  was  given  a  high  priority.  The  latest  customer  feedback  was  discussed  at  all  PIT 
meetings.  Based  on  the  customer’s  conunents  on  the  electronic  mail  trials,  we  expanded  the 
electronic  mail  database,  and  solicited  other  volunteers  to  use  the  program.  Based  on  the 
positive  feedback  regarding  the  analytical  results  cover  sheet,  we  have  continued  this  proce¬ 
dure. 

2.4.  Process  identification  and  definition. 

2.4.  A.  Dr  Cupello’s  advance  group  narrowed  the  scope  of  the  PIT  during  its  initial 
study  of  all  processes  and  the  overall  performance  of  the  laboratory.  Flow  Charts  and  Box 
and  Whisker  Diagrams  were  tools  the  Team  used  to  identify  processes  and  define  boundaries. 
The  Team  used  data  from  an  extensive  historical  database.  (See  Atch  2.4.  A.) 

2.4. B.  It  was  not  difficult  for  the  Team  to  determine  if  the  boundaries  of  the  process 
were  within  their  scope.  AL  leadership  empowered  the  Team  to  modify  any  applicable  busi¬ 
ness  practices.  Those  practices  selected  for  process  improvement  fell  functionally  within  the 
Analytical  Services  Division  (OEA)  and  its  Division  Chief  served  as  team  leader.  The  func¬ 
tions  on  which  the  Team  focused  were  showing  high  variability  and  long  average  analytical 
turnaround  times. 

2.5.  Opportunities  for  improvement  were  identified  and  prioritized  by  a  study  of  the  histori¬ 
cal  data  from  our  laboratory  information  system.  From  these  data,  the  advance  group  identi¬ 
fied  four  key  areas  for  improvements:  metal  analysis,  pesticide  analysis,  hazardous  waste 
analysis,  and  customer  service. 

2.6.  The  Team  evaluated  process  performance  with  metrics  developed  from  the  laboratory’s 
historical  data  base.  We  produced  Control  Charts,  Pareto  Charts,  and  Scatter  Diagrams  to 
analyze  turnaround  time  and  sample  workloads  for  each  targeted  area.  (See  Atch  2.6.) 

2.7.  A  schedule  for  process  documentation  and  leadership  reviews. 

2.7.  A.  The  Team  kept  on  schedule  and  provided  leadership  reviews  by  developing 
and  maintaining  milestones  based  on  our  charter.  Facilitators  followed  the  chart  and  kept  us 
focused  on  the  schedule.  Review  of  progress  often  was  made  an  agenda  item.  We  provided 
senior  leadership  reviews  through  the  storyboard  and  frequently  briefed  senior  management. 

2.7. B.  Dr  Welch  and  Mr  Mitchell  were  briefed  and  gave  approval  to  the  original  team 
charter.  They  also  requested  that  HSC  Quality  Council  be  briefed  quarterly,  thereby  keeping 
upper  management  informed  on  the  Team’s  progress  and  providing  an  opportunity  for  feed¬ 
back. 

3.  Analysis  Techniques 

3.1.  Analyze  the  process  for  improvement. 

3.1. A.  Process  analysis  began  with  a  general  review  of  OEA  procedures  and  func¬ 
tions,  including  a  tour  of  the  laboratory.  Next,  a  very  simple  chart  describing  the  flow  of  a 
sample  through  the  lab  was  created.  After  narrowing  the  focus  to  three  analytical  functions. 
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adfi&Nud  toms  were  made.  Bndnstonning  and  Affinity  techniques  then  were  used  to  estab¬ 
lish  general  process  stei»  for  Flow  Charting,  after  which,  a  detailed  Flow  Chart  was  created 
for  eich  tM  dote  targeted  analytical  fiinctians.  (See  Atch3.1.A.) 

3.1. B.  Lab  tours  were  especially  important  fmTeam  members  naive  to  OEA,  e.g., 
the  facilitators  and  the  customer  representative.  Their  simple  but  probing  questions  often 
revealed  process  steps  that  were  taken  for  g^ted  by  those  who  had  been  intimately  involved 
with  the  process.  The  initial  tour  revealed  six  major  process  steps:  shipping,  log-in,  analysis, 
rmrting,  verification,  and  nuiiling  results.  While  the  first  and  last  two  steps  were  similar  for 
all  samples,  the  analysis  and  vmification  steps  were  specific  for  each  of  eleven  types  of  func¬ 
tional  analyses  (See  previous  Atch  2.4. A.).  After  the  team  decided  to  focus  on  only  tluee  of 
die  eleven  functions,  detailed  tours  of  each  resulted  in  more  questions  and  copious  notes. 
Subsequent  Brainstorming  resulted  in  a  broad  process  outline  that  was  valid  for  the  analysis 
and  verification  steps  of  any  function.  Team  members  representing  specific  functions  were 
then  asked  to  develop  a  detailed  function-specific  flowch^  for  their  areas,  using  the  broad 
outline  devised  by  die  team.  These  Flow  Charts  were  presented  to  the  team,  critiqued,  and 
revised.  Brainstemning  and  Affinity  Diagraming  were  used  to  help  identify  bottlenecks  in 
problem  areas. 

3.2.  Measurement  of  the  process  identified  as  relevant  to  customer  needs/satisfaction. 

3.2. A.  Data  on  turnaround  time  for  every  analytical  sample  processed  by  OEA  since 
1991  were  available  to  the  Team  in  a  laboratory  information  system  (Hewlett  Packard 
LahAJX)  computer  database.  While  this  database  had  been  routinely  maintained,  it  had  never 
before  bMn  queried  in  the  manner  and  detail  required  for  Team  use.  Team  members  wrote 
programs  to  extract  the  desired  data  and  TQM  statistical  process  control  software,  developed  by 
the  Air  Force  Materiel  Command,  was  used  to  generate  Control  Charts.  Initial  Control  Charts, 
along  with  Box  and  Whisker  summaries  of  the  same  data,  were  used  to  determine  target  func¬ 
tion  baselines.  After  narrowing  the  Team’s  scope,  we  developed  specific  Control  Charts  for 
each  of  the  targeted  functions  and  considered  other  factors,  such  as  the  day  of  the  week  a  sample 
was  received,  die  number  of  analyses  required  per  sample,  analytical  equipment  utilized,  and 
volume  of  samples  processed  at  the  same  time.  (See  Atch  3.2.  A.) 

3.2. B.  Early  in  process  analysis,  we  learned  that  some  data  fields  in  the  database  were 
automatically  entered  during  certain  operations  whereas  other  fields  were  copied  from  forms 
and  entered  manually.  It  was  easy  to  determine  that  the  automatically  recorded  data  were 
more  complete  and  valid,  so  the  Team  limited  its  review  to  those  data  as  much  as  possible. 
Furthermore,  statistical  analysis,  as  well  as  direct  observation  of  our  Control  Charts  and  Box 
and  Whisker  Diagrams,  revealed  an  inordinate  number  of  outliers,  which  we  were  able  to 
trace  to  consistent  but  inappropriate  inclusion  of  certain  types  of  data  in  our  original  analyses. 
These  data  were  those  from  samples  transshipped  to  contractors,  samples  generated  by  a 
special  Environmental  Protection  Agency  program.  Quality  Control  samples,  and  canceled 
samples.  We  modified  our  programs  accordingly,  thereby  obtaining  much  more  valid,  accu¬ 
rate,  and  relevant  data  for  our  process  measurement  of  in-house  analytical  performance.  The 
revised  analyses  still  demonstrated  a  great  opportunity  for  improvement  in  the  targeted  func¬ 
tions. 

3.3.  Problem  identification 

3.3. A.  To  facilitate  problem  and  solution  identification,  the  Team  visited  two  pre¬ 
miere  national  analytical  laboratories  in  Salt  Lake  City.  Hie  fresh  ideas  generated  from  this 
trip,  along  with  the  results  of  our  own  process  identification  and  measurement,  were  used  to 
Brainstorm  and  record  as  many  candidate  problem  areas  as  possible.  Then,  using  an  Affinity 
Diagraming  tool,  problem  areas  were  clustered  and  grouped  into  six  primary  categories. 
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which  then  made  the  majw  ribs  of  a  Fishbone  Diagram.  Secondary  and  tertiary  ribs  were 
derived  from  the  affinity  groupings  and  supplemented  by  additional  Brainsumning.  (See  Atch 

3.3. A.:  iKrte  that  the  Affinity  Diagram  was  (testroyed  to  make  the  original  Fishbone  Diagram 
and  th^frne  couldn’t  be  included.) 

3.3.B.  A  two  suige  process  was  used  to  determine  the  most  significant  areas  for 
improvement  Hist  using  Ae  extensive  experience  and  expertise  of  the  group,  we  labeled, 
by  consensus,  die  various  ribs  of  the  Hshbone  Diagram  as  having  a  large,  m^um,  or  small 
effect  on  turnaround  time  (See  previous  Atch  3.3.  A.);  eleven  of  the  candidate  problem  areas 
were  labeled  as  having  a  l^e  influence.  Next  wc  utilized  the  Interrelationship  Digraph 
tecimique  to  pairwise  rank  tlwse  eleven  factors  in  order  to  determine  which  were  the  driving 
or  root  causes.  Of  the  five  driving  factors  (those  with  the  most  "out”  arrows  on  the  digraph) 
two.  New  Regulations  and  Slow  Procurement  were  considered  out  of  the  Team’s  control. 

The  three  remaining,  coordination,  automation,  and  personnel  experience,  were  thus  identi¬ 
fied  as  being  the  most  significant  improvement  opportunities  in  our  control.  (See  Atch  3.3.B.) 

3.4.  Throughout  the  whole  procedure  of  process  analysis,  process  measurement  and  problem 
identification  the  Team’s  attention  was  constantly  focused  on  the  customer’s  most  significant 
requirement  namely  an  improvement  in  turnaround  time.  The  Team  also  was  alert  to  the  fact 
that  other  customer  requirements,  which  were  not  perceived  as  a  problem,  could  not  be  sacri¬ 
ficed  to  improve  turnaround  time.  Customers  were  often  asked  for  their  comments  on  chang¬ 
es  the  Team  were  considering.  During  team  meetings,  the  internal  customer  on  the  team 
helped  keep  our  focus  on  customer  requirements  and  became  the  leader  for  developing  coor- 
iination  alternatives  with  the  customer. 

3.5.  The  specific  processes  chosen  for  improvement  were  defined  in  the  Flow  Charts  includ¬ 
ed  earlier  (See  previous  Atch  3.1.).  The  improvement  approaches  were  identified  as  de¬ 
scribed  above  and  further  elaborated  in  Tree  Diagrams  utilized  in  delineating  root  causes  (see 
Atch  to  later  section,  3.6.  A.)  A  letter  was  issued  by  the  Division  Chief  to  the  Branch  Chiefs 
to  communicate  the  Team’s  decision.  (See  Atch  3.5.) 

3.6  Root  cause  analysis. 

3.6. A.  Brainstorming,  Multivoting,  and  Affinity  Diagraming  were  used  to  develop 
Tree  Diagrams  to  identify  root  causes  and  a  range  of  possible  solutions  for  each  problem  area. 
(See  Atch  3.6.  A.) 

3.6. B.  In  order  to  verify  root  causes,  appropriate  team  members  developed  check 
sheets,  data  forms,  and  survey  tools  to  assess  baseline  times  required  for  identified  root  caus¬ 
es.  For  example,  customers  were  queried  on  the  time  it  took  to  receive  mailed  results,  chem¬ 
ists  recorded  the  time  to  complete  manual  calculations,  and  function  managers  recorded  the 
time  required  to  verify  and  sign  reports. 

3.7.  After  problem  identification  and  the  analysis  of  root  causes,  described  earlier,  final 
target  selection  was  done  using  two  approaches.  First,  we  employed  Criteria  Development 
and  Prioritization  Matrix  procedures,  described  more  fully  in  section  4.2  (See  Atch  4.3.)  and 
second,  we  performed  a  risk/benefit  analysis,  which  involved  a  variety  of  issues,  including 
Division  dynamics,  and  led  to  the  exclusion  of  certain  possible  solutions  from  consideration. 

4.  Solutions 

4.1.  Possible  solutions  were  identified  simultaneously  with  root  causes  using  Brainstorming, 
Multivoting,  Affinity  Diagrams,  and  Tree  Diagrams  (Sre  previous  Atch  3.6. A.).  It  was  at 
this  critical  stage  in  Team  activity  that  previous  groundwork  began  to  really  pay  off.  The 
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cxi^nal  careful  selection  and  training  of  team  members,  the  cross  functional  education  in 
Ol^  ixocess  of  all  members,  our  fact-finding  tour  of  premiere  national  labs,  the  use  of  TQ 
teaming  procedures,  and  the  "just-in-time"  introduction  and  use  of  TQ  tools  all  contributed  to 
a  smoc^y  functioning  group  of  experts  that  was  optimally  prepared  for  identifying  and  pri- 
(xitizing  possible  solutions.  Assistance  and  advice  on  possible  solutions  were  also  elicit^ 
fiom  o&r  expemnced  OEA  personnel,  who  had  not  had  the  opportunity  to  participate  in 
earlier  Team  activities. 

4.2.  In  order  to  assess  the  best  solutions,  the  Team  first  developed  a  set  of  implementation 
criteria  and  assigned  weightings  using  a  modified  version  of  the  Full  Analytical  Criteria 
Method.  The  original  criteria  were:  low  cost,  low  manpower,  no  effect  on  quality,  not 
impeded  by  regulations,  laige  reduction  in  turnaround  time,  high  chance  of  success,  high 
spin-off  potential,  and  short  time  to  implement.  (After  experience  with  the  method,  a  number 
of  criteria  were  later  deleted.)  Then,  using  a  Prioritization  Matrix  technique,  tiie  various 
solutions  developed  using  Tree  Diagrams  (See  previous  Atch  3.6.  A.)  were  rated  on  each  of 
tile  criteria.  After  being  multiplied  by  the  criteria  weightings,  the  adjusted  ranks  were 
summed  across  criteria  to  yield  a  relative  priority  rating  for  each  solution.  From  this  matrix, 
the  Team  chose  to  implement  solutions  that  had  received  the  highest  priory  ratings. 

4.2*  After  choosing  target  solutions,  the  Team  broke  into  several  subgroups  to  develop  and 
implement  specific  action  plans.  Progress  was  reported  and  discussed  at  weekly  meetings  of 
the  whole  Team.  Examples  of  three  different  action  are  provided.  Also  includ^  are  the  tinal 
results  from  the  prioritization  matrices  on  which  all  actions  plans  were  based.  (See  Atch  4.3.) 

4.4.  The  Team  tested  all  solutions  on  a  small  scale.  For  example,  three  appropriate  Air 
Force  bases  were  selected  to  test  effects  of  sending  analytical  reports  by  electronic  mail; 
results  were  sent  by  electronic  mail  for  two  months,  and  feedback  was  solicited  from  the 
customer.  A  similarly  cautious  test  was  conducted  on  the  response  to  our  changing  the  way 
analytical  results  are  signed  off  by  the  chemist;  we  included  a  paragraph  to  the  customer  on 
the  new  version,  explaining  the  change  and  soliciting  comments  and  suggestions.  We  worked 
directly  with  our  MAJCOM  customers  on  how  to  better  schedule  sample  workload,  again 
explaining  our  proposals  and  soliciting  feedback. 

4.5.  The  Team  ensured  implementation  of  the  action  plans  by  including  affected  personnel, 
especially  supervisoiy  personnel  and  Branch  Chiefs,  in  their  development  and  execution. 
Often,  affect^  personnel  were  invited  to  a  weekly  Team  meeting  at  which  a  progress  report 
on  their  area  was  on  the  agenda.  Status  of  implementation  was  typically  an  agenda  item  on 
weekly  meetings.  Occasional  briefings  by  Mr.  Thomas  to  the  OEA  Division  staff  members 
also  enlisted  tiwir  support  and  helped  ensure  timely  implementation. 

5.  Results 

5.1.  Results  of  the  team’s  solutions  met  or  exceeded  customer  requirements. 

5.1.  A  Results  derived  from  the  Team’s  process  improvement  efforts  fall  into  two 
main  types.  The  frrst  type  relates  to  the  effects  of  specific  process  changes  that  were  expected 
to  improve  turnaround  time.  The  results  of  these  efforts  are  clearly  successful.  Because  of 
changes  in  the  procedures  by  which  chemists  sign-off  on  analytical  results,  this  type  of  paper 
work  has  decreased  from  57  to  74%  in  targeted  areas.  New  electronic  mailing  procedures 
now  provide  results  to  the  customer  within  10  minutes  of  chemist  approval,  compared  to  4-6 
days  required  previously  for  postal  delivery.  In  another  case,  implementation  of  new  auto¬ 
mated  procedures  has  reduc^  by  50%  the  time  required  to  download  and  quality  control  data. 

The  second  type  of  result  relates  to  improvements  in  overall  turnaround  time.  While 
overall  turnaround  time  for  our  targeted  functions  has  decreased  30  to  36%,  compared  with 


baseline  performance,  changes  have  been  in  place  for  far  to  short  a  time  for  these  results  to  be 
conclusive.  During  the  course  of  our  examination  of  OEA  processes,  we  learned  that  there 
are  a  great  many  factors  affecting  overall  turnaround  time,  many  of  which  are  uncontrollable 
and  somewhat  unpredictable.  For  example,  during  the  same  time  that  turnaround  times  have 
declined,  workload  has  increased  by  30  to  38%,  compared  with  the  baseline  period. 

Aldiough  we  are  optimistic  that  turnaround  times  will  remain  lower  and  decline  even  more, 
we  feel  we  need  at  least  six  additional  months  of  data  to  make  an  adequate  assessment. 

There  also  have  been  many  positive  spin-offs  resulting  from  our  improvements.  The 
use  of  signati  cover  letters,  electronic  transfer  of  results,  and  automated  downloading  of 
analytic^  data  has  been  adopted  by  four  additional  functions,  not  originally  targeted  by  the 
Team.  Increased  automation  has  led  to  personal  computers  tluoughout  the  work  area,  speed¬ 
ing  data  handling  and  communications.  Our  introduction  of  daily  and  weekly  sample  man¬ 
agement  suspense  lists  allows  chemists  to  identify  and  expedite  older  samples,  reducing  peaks 
in  analysis  turnaround  times. 

In  the  analytical  services  business,  it  is  difficult  to  immediately  measure  whether  our 
solutions  meet  or  exceed  the  customer  requirements.  There  are  many  variables  that  effect 
each  sample,  and  while  a  customer  will  immediately  notice  if  a  single  sample  is  very  late,  the 
same  customer  might  be  slow  to  realize  that  ten  other  samples  have  been  analyzed  20  or  30% 
faster.  However  positive  customer  feedback  on  our  initial  steps,  especially  electronic  mailing, 
show  we  are  on  the  right  track. 

5.1. B.  The  results  of  specific  process  changes  are  easy  to  link  directly  to  team  efforts. 
The  idea  for  having  a  single  signature  cover  letter  originated  in  the  team  and  was  researched 
and  tested  by  the  team  prior  to  implementation;  this  prime  example  of  finding  and  eliminating 
non-value  added  work,  caused  an  immediate,  significant  time  savings,  clearly  attributable  to 
the  Teamu  Similarly,  the  Team’s  introduction  of  electronic  mailing  of  analytical  results  was 
logically  developed  using  TQ  tools,  tested  and  revised,  and  then  transitioned  to  the  whole 
DivisioiL  This  change  saved  days  of  turnaround  time;  the  customers  like  it;  and  it  would  not 
have  happened  without  the  Team’s  efforts. 

vhiile  the  Team  believes  it  has  had  a  major  impact  on  overall  turnaround  time,  it  is 
doubtful  that  such  a  global  variable  can  ever  be  conclusively  proven  to  have  been  caused 
exclusively  or  directly  by  the  Team’s  changes.  In  an  organization  as  complex  and  dynamic  as 
OEA  and  with  a  metric  as  multidependent  as  turnaround  time,  it  is  impractical  to  conduct  a 
controlled,  scientific  study.  However,  since  the  time-saving  changes,  described  above,  have 
shortened  component  parts  of  the  overall  turnaround  process,  we  feel  confident  in  extrapolat¬ 
ing  that  our  Team’s  efforts  were,  at  least  partially,  responsible  for  the  observed  improvements 
in  on  overall  turnaround  time. 

Phenomena  such  as  enthusiasm,  cooperation,  and  esprit  de  corps  are  difficult  to 
measure,  but  we  know  that  they  affect  the  productivity  of  an  organization  and  that  they  have 
dramatically  increased  in  OEA  over  the  past  year.  The  Team  would  not  presume  to  take 
credit  for  all  of  the  altitudinal  improvements  in  the  Division,  but  can  certainly  attest  to  the 
positive  effect  participation  in  the  PIT  had  on  its  own  members. 

5.2.  The  Team’s  results  meet  the  HQ  AFMC  and  HSC  goals  and  objectives,  earlier  described 
with  respect  to  Team  mission  (See  previous  section  1.1  .D.).  If  our  decreases  in  overall  tur¬ 
naround  time  are  sustained,  we  will  definitely  have  satisfied  our  customers’  needs.  Electronic 
reporting  of  results  clearly  supports  our  objective  of  helping  customers’  meet  their  schedules. 
Streamlining  and  automation  of  operations  have  greatly  enhanced  our  business  practices.  The 
new  esprit  de  corps  and  enthusiasm  at  all  levels  in  the  laboratory  are  indicators  of  success  in 
enabling  our  people  to  excel.  Our  use  of  advanced  automated  technology  has  enhanced  the 
technological  superiority  of  our  lab.  Our  improved  ability  to  provide  timely  environmental 
analyses  supports  the  operation  of  quality  installations  throughout  the  Air  Force.  We  now 
have  the  capacity  and  excellence  to  attract  and  sustain  new  business.  Our  Team’s  results 
strongly  support  the  goals  and  objectives  of  our  organization. 
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ILDeployiimt 

6.1.  During  preliminarily  testing  and  adjusting  of  the  proposed  process  changes.  Branch 
Chiefs  and  actional  Function  Chiefs  from  the  areas  most  affected  were  invited  to  attend 
Team  meetings.  Their  presence  and  involvement  in  the  ensuing  discussions  proved  extremely 
valimble  to  tte  implementation  of  the  changes.  After  the  concurrence  of  these  leaders  was 
secured,  tihe  Team  scheduled  briefings  for  ^  entire  OEA  division,  at  which  proposed  process 
changes  were  discussed  in  detail  and  comments  were  solicited.  As  the  scheduled  dates  for 
inq>lementation  drew  near,  division  personnel  were  updated  via  electronic  mail.  This  ap¬ 
proach  allowed  our  introduction  of  an  analytical  report  cover  sheet  and  electronic  mailing  of 
results  to  expand  from  the  initial  test  cases  to  becoming  standardized  procedures  for  the  whole 
Division.  To  inform  and  involve  the  customer,  the  Team  Leader  visited  several  AF  Com¬ 
mand  HQs  and  briefed  Icey  personnel  on  proposed  improvements  being  considered  by  OEA. 
This  information  was  also  made  available  on  the  OE  Directorate  electronic  bulletin  board,  to 
which  over  240  of  OEA's  customer  groups  have  access. 

6.2.  The  Team  believes  that  improvements  in  information  availability  and  tracking,  commu¬ 
nication,  and  a  new  spirit  of  cooperation  will  ensure  that  the  increas^  level  of  performance  is 
maintained  and  shared.  As  a  direct  result  of  the  Team’s  demands  for  data  analysis  and 
automation,  information  from  the  OEA  database  is  much  more  readily  available.  The  Team 
n(^  only  acquired  workplace  computers  and  developed  software  to  automatically  download 
data  from  analytical  equipment,  but  also  developed  a  maintenance  procedure.  Our  program¬ 
mer  has  followed  up  with  the  chemists  to  ensure  the  new  output  meets  their  needs,  and  will 
stay  available  to  support  changes.  New,  weekly  metrics  on  turnaround  time,  workload, 
accuracy,  productivity,  backlog,  and  many  other  parameters  are  now  available  by  analytical 
function  to  nearly  all  lab  personnel.  Regular  tracking  of  such  metrics  is  now  required  by 
management,  ensuring  that  quality  is  maintained  as  turnaround  time  is  decreased.  Communi¬ 
cation  within  OEA  has  improved  considerably  and,  through  a  reorganized  customer  service 
area,  communication  with  customers  has  never  been  better.  Finally,  our  effective  demonstra- 
tkm  that  empowerment  and  teamwork  can  lead  to  meaningful  process  improvements  has  re¬ 
sulted  in  a  positive,  energetic,  and  cooperative  spirit  in  OEA  that  will  ensure  increased  per- 
fmmance  is  maintained  and  shared  well  into  the  future. 

6.3.  As  a  result  of  the  Team’s  recommendations,  the  OEA  Division  has  implemented  on¬ 
going  bench-level,  process  control,  and  management  metrics  to  monitor  results  and  ensure 
continuous  process  improvement.  For  management  at  the  bench  and  Function  Chief  levels, 
the  team  instituted  a  daily  "sample  suspense  list"  and  a  weekly  "sample  suspense  management 
list",  for  use  in  tracking  sample  turnaround  time.  These  lists  provide  a  detailed  look  at  the 
status  of  all  samples.  Chemists  can  use  them  to  control  work  flow  and  meet  analysis  times. 
Function  Chiefs  use  the  lists  to  manage  personnel,  schedule  equipment  maintenance,  and 
decide  when  to  augment  in-house  resources  with  contract  laboratory  capability.  Branch  and 
Function  Chiefs  now  also  receive  weekly  consolidated  Control  Charts  on  the  customer’s  key 
interest  areas,  allowing  them  to  assess  trends  and  anticipate  problem  areas.  (See  Atch  6.3.) 

7.  Presentation 

7.1.  The  primary  tool  we  used  for  internal  evaluation  was  that  of  holding  a  critique  session  at 
the  end  of  each  Team  meeting.  This  critique  involved  the  facilitator  asking  each  Team 
member  what  that  person  lik^  best  about  the  meeting  and  what  that  person  would  have 
improved.  The  responses  were  written  down  on  a  large  tablet  for  all  members  to  see  and 
were  included  in  the  minutes  of  the 'meeting.  Common  complaints  involved  infractions  of  the 
Code  of  Conduct,  concerns  about  losing  focus  or  not  making  rapid  enough  progress,  and  the 
need  for  more  resources.  Sometimes  the  issues  raised  could  be  dealt  with  immediately,  but 
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dften  they  were  included  in  the  official  agenda  for  the  next  meeting.  Most  of  the  time,  the 
positive  comments  outweighed  the  negative  and  only  minor  corrections  were  needed  to  keep 
the  Team  on  course.  Initijdly,  the  Team  facilitators  held  separate  discussions  with  the  Team 
leader  to  evaluate  internal  Team  functitming.  These  discussions  were  helpful  at  the  time  but 
became  unnecessary  as  the  Team  nuitured. 

7.2  How  did  the  team  evaluate  its  performance  extcmallv? 

7.2.  A.  The  most  severe  problem  faced  by  the  Team  was  a  drain  on  human  resources. 
Midway  through  the  Team’s  progress,  two  members  were  lost,  one  due  to  promotion/reas- 
signment,  and  one  due  to  unexpected  retirement  The  Team  responded  by  adjusting  the  scope 
of  the  remaining  woric  and  by  getting  the  temporary  assistance  of  others  with  suitable  exper¬ 
tise.  Another  human  resource  problem  was  the  increasing  demands  on  some  of  the  Team 
members  whose  regular  duties  were  in  organizations  other  than  OEA;  this  time  the  Team 
appealed  to  higher  OE  and  AL  leadership  for  a  restoration  of  personnel  resources  and  was  at 
least  partially  successful.  A  third  problem  was  that  of  obtaining  adequate  and  timely  physical 
resources,  particularly  computer  hardware  and  software.  As  in  other  activities,  the  team  took 
a  combined  "can  do"  and  "make  do"  cooperative  approach  to  get  the  job  done.  For  example, 
one  member  might  obtain  a  surplus  computer,  another  the  software,  and  another  a  peripheral 
device  to  create  a  needed  system. 

7.2. B.  It  is  readily  apparent  that  there  have  been  many  spin-offs  and  general  benefits 
of  out  Team  to  the  organization.  Most  important  is  the  fact  that  our  Team’s  success  has 
demonstrated  that  there  exists  a  willingness  and  a  means  for  effective  change  in  the  organiza¬ 
tion.  In  these  days  of  downsizing,  yet  increasing  work  load,  it  is  easy  to  become  discouraged 
and  depressed.  It  is  clear  to  OE  and  AL  management,  and  to  the  Team  itself,  that  its  activi¬ 
ties  have  increased  spirits  and  reinstated  confidence  in  all  those  involved  in  the  endeavor. 
Another,  more  tangible  benefit  of  the  Team’s  existence  was  a  great  improvement  in  communi¬ 
cation  within  the  OEA  Division  and  an  increase  in  widespread  understanding  of  Division 
processes.  The  invigorated  OEA  spirit  and  increased  ex^^rtise  were  both  demonstrated  re¬ 
cently  when  a  report  of  the  AF  Audit  Agency  required  a  complex  and  rapid  response.  Anoth¬ 
er  benefit  of  the  OEA  Team’s  efforts  to  the  broader  organization  has  been  the  initiation  of  TQ 
teams  in  other  OE  Divisions  by  persoimel  who  honed  Aeir  skills  on  the  OEA  Team. 

7.2. C.  The  OEA  Team’s  most  compelling  communication  tool  was  a  40  square  foot, 
highly  attractive,  storyboard.  After  its  initial  development  in  the  OEA  work  area,  this 
dramatic  display,  which  told  the  Team’s  story  in  easy  to  follow  charts  and  illustrations,  was 
placed  for  sever^  months  in  the  highly  trafficked  lobby  of  the  AL  command  building.  There 
it  conveyed  the  message  of  an  energetic  TQ  effort  to  employees  throughout  AL  as  well  as  to 
many  visitors  from  other  organizations.  The  Team  also  used  briefings  and  publications  to 
share  its  experiences  with  others.  At  various  times  during  the  year,  the  team  leader,  Mr 
Thomas,  formally  briefed  AL,  OE,  and  HSC  senior  management,  the  HSC  Quality  Council, 
all  employees  in  the  OEA  Division,  specialized  audiences  in  the  OE  Directorate,  and 
MAJCOM  headquarters.  The  activities  of  the  Team  were  discussed  in  AL’s  Quality  Air 
Force  Newsletter,  and  the  Brooks  AFB  newspaper.  Customers  were  advised  of  Team  actions 
through  an  article  in  the  OE  newsletter,  which  is  distributed  AF-wide  to  civil  engineer  and 
medical  customers,  and  by  adding  a  paragraph  to  our  sample  results  sheets,  which  go  directly 
to  the  technicians  in  the  field.  Finally,  Team  benefits  and  lessons  learned  were  spread  verbal¬ 
ly  to  others  directly  by  each  Team  member;  in  three  clear  cases,  team  members  used  exper¬ 
tise  and  experience  gained  on  the  OEA  team  to  benefit  TQ  activities  in  other  organizations. 
(SeeAtch7.2.C.) 
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ATTACHMENT  1.1B 

ATTACHMENT  1.1E 

ATTACHMENT  1.2C 

ATTACHMENT  2.1  - 

ATTACHMENT  2.2A 

ATTACHMENT  2.3A 

ATTACHMENT  2.4A 

ATTACHMENT  2.6  - 


ATTACHMENTS 

-  TEAM  PURPOSE 
Mission  Statement 
Scope  of  PIT  Group 
Adminstrative  Issues 
Empowerment  issues 
Code  of  Conduct 

-  PIT  MEMBERSHIP 
Membership  Selection  Criteria 
Laboratory  Staffing  Diagram 
Team  Membership 

-  TIME  MANAGEMENT  AND  GUIDELINES 
Meeting  Agenda  Example 

PIT  Group  Milestone  Chart 
Continuous  Process  improvement  Guide 

CUSTOMER  IDENTIFICATION 
Analytical  Services  Customers 
FY92  Customers  by  Command 

-  TOOLS  USED  TO  SURVEY  CUSTOMERS 
Environmental  Sample  Analysis  Questionaire 

-  CUSTOMER  SATISFACTION  DATA 

Key  Parameters  of  Customer  Satisfaction 

-  FLOW  CHART  AND  STUDY  OF  ANALYTICAL 
CHEMISTRY  PROCESSING  STEPS  IN  THE  LABORATORY 
Process  Flow  Chart 

Codes  for  Analysis  Functions 
Box/Whisker  Diagram  for  Process 
BoxANhisker  Diagrams  for  Analysis  Times 

EVALUATION  OF  PROCESS  PERFORMANCE 
Samples  Received  Control  Charts 
In-house 
Total 

Analysis  Times  Control  Charts 
Metals 
Pesticides 
Scatter  Diagrams 
Pareto  Chart 
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ATTACHMENT  3.1  A  -  TOOLS  USED  TO  ANALYZE  THE  PROCESS 

Metals  Analysis  Flow  Chart  (condensed) 

Raw  Chart 

Customer  Services  Flow  Chart  (condensed) 

Pesticide  Analysis  Flow  Chart 
Sample  Process  Flow  Chart 

ATTACHMENT  3.2A  -  PROCESS  PERFORMANCE  BASELINE 

Control  Charts: 

Metals(01)-1991 
Metals(01)-1992 
Pesticides(04)-1991 
Pesticides(04)-1992 
Samples  Received 

ATTACHMENT  3.3A  -  IDENTIFICATION  OF  POTENTIAL  AREAS  FOR  PROCESS 

IMPROVEMENT 

Metals  Analysis  Fishbone  Diagram 
Laboratories  Visit  Findings 

ATTACHMENT  3.3B  -  DETERMINATION  OF  MOST  SIGNIFICANT  IMPROVEMENT 

OPPORTUNITIES 
Interrelationship  Digraph 

ATTACHMENT  3.5  -  FINAL  STATEMENT  OF  THE  PROCESS  TO  BE  IMPROVED 

Division  Chief  Letter 

ATTACHMENT  3.6A  -  TOOLS  USED  IN  ROOT  CAUSE  ANALYSIS 

Tree  Diagrams: 

Improve  Automation  v 
Work  Flow  Management 
Personnel  Experience 

ATTACHMENT  4.3  -  TEAM  ACTION  PLANS 

Direct  Data  Transfer  Plan 
Electronic  Result  Mailing  Plan 
Coversheet  Plan 

Matrix  Diagram  -  Work  Flow  Management 
Root  Cause  Ratings: 

Improve  Automation 
Work  Flow  Management 
Personnel  Experience 
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ATTACHMENT  6.3  -  METRICS  USED  ON  AN  ON-GOING  BASIS  TO  ENSURE 

CONTINUOUS  PROCESS  IMPROVEMENT 
Performance  Charts 
Sample  Suspense  List 
Sample  Suspense  Management  List 

ATTACHMENT  7.2C  -  BENEFITS  OF  THE  TEAM  AND  LESSION  LEARNED  THAT  WERE 

COMMUNICATED 
Storyboard  Photo 
AL  Newsletter  Article 
OE  Newsletter  Article 
Customer  Satisfaction  Survey 
Customer  Feedback  Electronic  Mailing 
Cover  Letter  Explanation 
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Attachment  1.1  B  -  Team  Purpose 
When  Prepared:  August  1992 

Need/Purpose:  Mission  Statement  and  Scope  -  Direction 

for  Team 

Administrative  Issues  -  Guidelines  for  Team 

Empowerment  Issues  -  Support  by 
Management 

Code  of  Conduct  -  Rules  for  Team 

How:  Mission  Statement  and  Scope  -  Developed  by  Team  in 

Brainstorming/Sessions 

Administrative,  Empowerment  Issues  -  Developed  by 

Mr  Thomas,  Dr  Cupello  and  agreed 
upon  by  Dr  Billy  Welch,  AL/CC 

Code  of  Conduct  -  Developed  by  Team  during  Team 

Training  Process 
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TEAM  MISSION  STATEMENT 
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SCOPE  OF  PIT  GROUP 
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EMPOWERMENT  ISSUES 
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Attachment  1.1  E  -  PIT  MEMBERSHIP 

When  Prepared:  July  1992 

Need/Purpose:  To  select  an  effective  team 

How:  Membership  Selection  Criteria  -  Developed  by 
Mr  Thomas  and  Dr  Cupello  to  determine  team 
membership. 

Laboratory  Staffing  Diagram  -  Used  by  Mr  Thomas  to 
select  members  ensuring  laboratory-wide  representation. 

Team  Members  Chart  -  Final  team  selection 
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MEMBERSHIP  SELECTION  CRITERIA 
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WAY  IT'S  ALWAYS  BEEN  DONE 


Name  Duty  Title  Office  Symbol  Team  Function 

2Lt  Cliris  Cortez  Deputy,  Trace  Organics  AL/OEAE  Trace  Organics 

Ms  Lupe  Cruz,  GS5  Chief,  Customer  Service  AL/OEAT  Customer  Service 

Dr  Jim  Cupello,  GM  i  5  Total  Quality  Advisor  AL/TQ  Total  Quality  Advisor 
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Attachment  1 .2C  -  Time  Management  and  Guidelines 

When  Prepared;  Meeting  Agenda:  13  October  1992 

Milestone  Chart:  August  1992 
CPI:  Early  1992 

IMeed/Purpose:  To  ensure  the  team  stayed  on  the  original 

timeline  and  meet  the  steps  necessary  to 
to  identify  and  improve  problems. 

How:  Meeting  Agenda  -  Developed  by  group  participation  at 

end  of  each  meeting.  Agenda  was 
set  for  next  meeting. 

Milestone  Chart  -  Developed  by  Team  Leader 

CPI  -  14  Step  method  for  PIT  groups  to  use. 

Developed  by  Dr  Cupello  for  use  by  Armstrong 
Laboratory  PIT  groups. 
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Meeting  Agenda 
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'All  good  meciingt  eventually  degenerate  into  work.'  (Peter  Drucker) 
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14  Step  Method  For  Continuous  Process  Improvement 
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The  Armstrong  Laboratory  14  Step 
Method  For  Continuous  Process  Improvement  (CPI) 


T 

JILhere  are  literally  dozens,  if  not  hundreds, 
of  process  improvement  recipes  used  by  various 
companies,  government  agencies,  total  quality 
gurus,  etc.  In  developing  this  employee  hand¬ 
book  we  looked  at  a  number  of  them. 

For  example,  Dow  Chemical  Company 
describes  a  10-step  method  in  their  employee 
QUALITY  PERFORMANCE  GUIDEBOOK. 
Lockheed  Corporation  publishes  a  S-step  process 
in  their  GUIDELINES  AND  TOOLS  FOR 
CONTINUOUS  IMPROVEMENT  booklet. 

Joiner  Associates  Inc.  publishes  a  copyrighted 
booklet  entitled  the  JOINER  7  STEP  METHOD. 
The  Xerox  Corporation  U.S.  Marketing  Group 
employs  a  9-step  quality  improvement  process  in 
their  USMG  PARTNERSHIP  booklet.  Mr. 
Hitoshi  Kume,  1989  winner  of  the  Doming  Prize 
for  individual  achievement  describes  a  7-step 
process  in  Chapter  10  of  his  1985  book  entitled 
STATISTICAL  METHODS  FOR  QUALITY 
IMPROVEMENT.  The  Japanese  Union  of 
Scientists  and  Engineers  (JUSE)  Problem  Solving 
Research  Group  recommends  a  14-step  process. 
Electronic  Systems  Center  and  the  Rome  Labora¬ 
tory,  our  sister  DOD  laboratory,  employ  a  7-step 
model  when  training  their  process  improvement 
teams.  Lam,  Watson  and  Schmidt  offer  a  14-step 
and  9-step  methodology  in  their  1991  textbook 
entitled  TOTAL  QUALITY.  Peter  Scholtes,  in 
the  highly  acclaimed  TEAM  HANDBOOK, 
describes  a  5-step  method.  Boeing  Aerospace 
Company  teaches  a  9-step  problem-solving 
process  in  their  TOTAL  QUALITY  IMPROVE¬ 
MENT  guide.  I  won't  bore  you  with  any  more 
examples,  but  there  are  plenty  of  them. 


uality  gurus  the  world  over  would  be  the 
first  to  admit  that  at  the  heart  of  each  of  these 
methods  listed  above  is  the  basic  Shewhart  Cycle, 
also  known  as  the  4-step  PDCA  (Plan,  Do, 
Check,  Act)  Cycle  or  Deming  Cycle.  So  why 
not  just  use  the  simpler  4-step  PDCA  cycle?  The 
more  detailed,  14-step  method  described  here 
provides  a  useful  framework  for  most  people  who 
are  just  beginning  to  become  involved  in  process 
improvement.  In  this  author's  experience  a  4- 
step  process  lacks  sufficient  detail  and  guidance 
to  help  the  beginner.  On  the  other  hand,  most 
experienced  practitioners  do  not  find  a  more 
detailed  methodology  to  be  a  burden;  successful 
teams  end  up  following  the  same  general  pattern 
irrespective  of  the  model  chosen.  So  the  14-step 
process  has  been  selected  because  of  its  utility  to 
both  "new"  and  "seasoned"  practitioners  alike. 

l^astly,  we  recommend  that  you  start  small 
with  your  process  improvement  efforts.  Pick  a 
problem  or  process  within  your  group's  total 
control;  ensure  you  can  identify  customers,  as 
well  as  your  product  or  service,  very  clearly;  and 
pick  a  problem  you  can  solve  in  3-9  months, 
including  the  time  it  takes  to  charter,  form  and 
train  a  small,  functional  team. 

Initially  follow  the  process  outlined  here 
as  closely  as  possible.  Use  it  as  a  crutch  until 
you  have  the  experience  to  customize  it  to  each 
situation.  But  most  of  all,  enjoy  the  challenge  of 
continuous  improvement.  It  will  be  the  hardest, 
and  most  enjoyable,  work  you  will  ever  do. 
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1.  Identify,  prioritize  and  select 
opportunities  for  improvement 


2.  Identify  the  customer(s)  of  primary 
concern  and  the  product  or  service  tar¬ 
geted  for  improvement 


3.  Select  team  members;  develop  a  Team 
’’mission  statement;"  negotiate  a  Team 
Charter  with  the  Quality  Council 


Plan 


4.  Describe  specific  characteristics 
of  the  problem  from  as  many 
perspectives  as  possible 


5.  Identify  the  process  that  is 
producing  the  troublesome  symp¬ 
toms  and  describe  this  process  in 
detail 


6.  Identify  key  parameters  for  measuring 
customer  satisfaction;  establish  targets  for 
improvement  whenever  possible 


sntify  the  probably  causes  of, 
riers  to,  process  improvement 
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1  Identify,  prioritize,  and  select 
opportunities  for  improvement. 


Hints 

Example 

What  issues  do  external  customers 
bring  to  the  attention  of  senior 
management  most  frequently? 

There  are  problems  everywhere,  both  large  and  small.  With  lim¬ 
ited  time,  money  and  people  resources,  only  the  most  important 
problems  should  be  addressed.  One  of  the  key  roles  of  senior 
management  is  to  prioritize  what  gets  done.  In  a  TQL  environ¬ 
ment,  this  means  the  Quality  Council  selects  and  charters  all  pro¬ 
cess  improvement  activity.  They  should  know  better  than  anyone 
the  major  concerns  of  external  customers. 

The  fictitious  example  to  be  used  throughout  this  booklet  involves 
the  following  concern,  expressed  by  the  head  of  the  Quality  Coun¬ 
cil. 

Which  new  products  and  services  do 
your  customers  keep  ’bugging’  you 
to  provide? 

"In  the  current  DOD  environment  of  base  clo¬ 
sures  and  force  reductions,  it  is  likely  that  this 
Laboratory  vi^ill  have  to  significantly  increase  its 
capacity  to  do  drug  testing  for  DOD  personnel. 
How  can  we  increase  the  number  of  samples  we 
process  per  month?" 

When  angry  customers  complain  to 
senior  leadership,  what  is  it  they 
complain  about  most  vehemently  or 
most  often? 

CAUTION;  Executives  tend  to  identify  large  system  problems 
like:  "Solve  world  hunger!"  System  problems  are  generally  too 
complex  to  attack  whole.  They  need  to  be  broken  down  into  their 
smaller  components  called  processes,  and  improved  one  process  at 
a  time.  By  definition  then,  your  team  is  likely  to  end  up  working 
on  a  problem  slightly  different  than  originally  identified  by  the 
Quality  Council.  You  need  to  manage  the  Council's  expectations  in 
this  regard  very  carefully. 
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Useful  Tools 
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Hints 


Notes  &  Data 


Wutt  issues  do  "AL  "  executives 
consistently  identify  as  major  barriers 
to  satisfying  the  external  customer? 


If  you  called  one  of  your  external 
customers  and  described  the  "team  * 
project  you  had  selected  as  a  continu¬ 
ous  improvement  project,  would  he/ 
sne  tell  you  to  pick  a  better  one? 


What  issues  do  middle  managers 
identify  as  the  ’really'  big  ones  that 


2  Identify  the  ciistomer(s)  of  primary 
concern  and  the  product  or  service 
targeted  for  improvement. 


Hints 


Example 


List  all  external  customers  currently 
using  the  system  or  process  identified 
in  Step  1.  Be  specific. 


The  process  owner  described  the  ”AL”  drug  testing  system  as 
shown  below.  Please  note  that  it  consists  of  a  number  of  processes. 


Receive 

Samples 


Initial 

Processing 


RIA 

Screen 


RIA  Repeat 
On  Positives 


What  does  each  of  these  customers 
expect  in  the  way  of  produas/ 
services?  Do  all  customers  expect 
exaaly  the  same  "thing?’ 


AF  Form  1890 
Received 


Prepare  GC/MS  Repeat 
AF  Form  1890  On  Positives 


NOTE:  The  last  two  process  steps  seem  to  offer  the  greatest 
potential  for  "reducing  cycle  time."  But  remember,  the  Quality 
Council  defined  the  problem  in  terms  of  "samples/ month." 


Describe  the  process  used  to  deliver 
this  produa /service  using  a  flow 
chart  with  no  more  than  5-10  process 
steps;  macro-flow  charting,  if  you 
will. 


The  only  external  customers  are  the  Air  Force  and  Marines  at 
15,000  and  5,000  samples  per  month,  respectively.  Monthly 
workloads  range  from  17,000-25,000  samples.  Two  Marine  bases 
account  for  80%  of  Marine  samples.  Over  100  Air  Force  installa¬ 
tions  submit  samples  to  the  Laboratory. 


CAUTION;  There  is  a  tendency  at  this  stage  to  try  and  define/ 
solve  the  problem.  But  we  are  still  attempting  to  identify  the 
process  we  are  going  to  propose  to  the  Quality  Council  for  im¬ 
provement.  Focus  on  process,  not  problem. 
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Hints  Notes  &  Data 


Miho  is  the  process  owner  for  this 
process?  Did  you  involve  him/her 
in  this  step? 


Who  on  the  Quality  Council  does  the 
process  owner  ultimately  report  to? 
If  no  one,  you  have  a  serious  prob¬ 
lem. 


Consider  which  external  customer  you 
might  invite  to  ’sit  ’  on  your  process 
improvement  team. 


3  Select  team  members;  develop  a  Team 
"mission  statement;"  n^otiate  and 
develop  a  Tbam  Charter  with  the 
Quality  Council. 


Hints 


Example 


Based  on  what  you  discovered  in  Step 
2,  who  should  be  on  the  team?  Will 
you  attempt  to  improve  all  ef  the  steps 
on  the  macro^w  dutrt,  or  will  you 
focus  on  those  few  steps  with  the 
greatest  potential  for  improvement? 


Lets  assume  that  the  Quality  Council,  appropriate  Director  and 
process  owner  all  agree  to  focus  on  the  last  two  steps  identified  on 
the  "macro"  flow  chart.  How  are  team  members  identified?  Sim¬ 
ply  stated,  the  process  owner  must  map  the  process  to  a  finer  level 
of  detail,  and  in  so  doing*  identify  key  players  in  the  process.  The 
people  who  do  the  work  are  the  best  qualified  to  improve  the  pro¬ 
cess,  if  they  are  trained  and  empowered. 


Are  the  supervisors  ttf  potential  team 
members  aware  that  this  process  is 
under  review?  Do  they  understand 
that  senior  management  is  sponsoring 
the  ^ort? 


Do  team  members  have  time  to  spend 
1-2  hours  per  week  in  team  activity? 
How  wiU  they  get  their  other  work 
done?  Note:  this  team  could  Junc¬ 
tion  for  6-12  months. 


Team  Leaden  John  Facilitator: 


Branch  A  Branch  B 


Branch  C 


CAUTION:  The  team  should  be  kept  small  (5-10  people).  Team 
members  need  training  in  group  dynamics  and  quality  tools  before 
being  asked  to  negotiate  a  team  charter  with  the  Quality  Council. 
Quality  takes  time. 
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Useful  Tools 


Hints  Notes  &  Data 


Does  the  process  owner  know  the 
detailed  process  well  enough  to 
reconmend  team  members?  If  not, 
find  someone  who  can. 


Which  members  of  the  Quality 
Council  are  stakeholders  of  the 
process  to  be  improved?  What 
restrictions  or  limits  might  they  place 
on  your  improvement  efforts?  Why? 


Which  team  members  will  negotiate 
the  team  charter  with  the  Quality 
Council?  Why  not  all  of  them? 
When?  Where?  How  long  will  it 
take?  How  polished  should  it  be? 


4  Describe  speciflc  characteristics  of  the 
"improvement  opportunity"  from  as 
many  perspectives  as  possible. 


Hints 


Example 


Historically,  what  land  ofperfor- 
numce  has  this  process  been  able  to 
deliver?  Plot  the  data  on  a  run  chart 
or  control  chart. 


"Skilled  original  investigators  and  private  detectives  always  use  a 
common  technique:  they  thoroughly  investigate  the  site  of  the 
crime  before  they  do  anything  else.  They  obtain  clues  from  the 
site  on  which  to  base  their  hunt  for  the  perpetrator,  and  gradually 
tighten  the  noose  around  the  suspect.  If  the  investigator  does 
not  thoroughly  appreciate  the  situation  where  the  crime  was  com¬ 
mitted  before  starting  the  search,  he  will  not  only  fail  to  find  the 
right  person,  but  may  wind  up  arresting  a  wholly  innocent  person. 
The  same  is  true  in  problem  solving."  [Hitoshi  Kume  in  STATIS¬ 
TICAL  METHODS  FOR  QUALITY  IMPROVEMENT,  1985.] 


From  a  time  perspeaive,  does  process 
variation  duuige  from  morning  to 
afternoon,  day  to  day,  week  to  week, 
month  to  month,  seasonally,  etc? 


From  a  location  perspeaive,  does 
process  variation  change  with 
different  suppliers,  how  and  where 
produa  is  stored,  how  produa  is 
shipped  to  the  customer,  geographic 
location  of  the  customer,  which 
machines  are  used  to  produce  it,  ac? 


XmR  Chart  For  Drug  Testing  Cycle  Time 


CAUTION:  The  objective  of  this  step  is  not  to  discover  the  causes 
of  the  problem  in  question,  but  to  understand  the  environment  in 
which  the  causes  have  been  able  to  survive  and  fluorish. 
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Useful  Tools 


Hints  Notes  &  Data 


Spend  time  at  the  process  location 
and  collect  information  that  cannot 
be  put  into  data  form. 


From  a  symptoms  perspective,  how 
do  "drfects’  reveal  themselves: 
schedule,  cost,  appearance,  funaiou 
ality,  accuracy,  etc? 


When  the  process  is  working  poorly 
or  producing  poor  results,  who  is 
involved  in  the  process  and  who  is 
not? 


4: 


5  Identify  the  process  that  is  producii^  the 
troublesome  symptoms  and  describe  this 
process  in  detail. 


Hints 


Example 


St^  2  mvolvtd  a  5-10  stqt  macro¬ 
flow  durt.  Step  3  was  approxinuuefy 
twice  as  detailed.  This  step  should  be 
as  detailed  as  the  bunvledge  of  the 
team  members  will  allow. 


Prior  to  flaw  charting,  simply  list 
every  known  step  in  the  process. 
Don 't  worry  about  'wiring '  the  steps 
together  utail  you  have  a  fairly 
complete  list. 


Use  'POST-IT NOTES’  to  record 
individual  process  steps  and  then 
arrange  these  slips  of  paper  in  a  flow 
dtari  format  on  the  walL 


Additional  work  by  Team  members  produced  the  following,  more 
detailed  flow  chart. 


CAUTION:  This  is  not  a  trivial  exercise.  The  extent  of  process 
improvement  is  directly  related  to  the  team's  intimate  knowledge  of 
the  process  they  are  improving.  Ultimately,  suggested  improve¬ 
ments  are  driven  by  in-depth  understanding  of  process. 
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Useful  Tools 


Hints 


Notes  &  Data 


Subdivide  the  process  flow  charting 
task  by  assigning  team  members  to 
those  aspects  of  the  process  they 
know  best.  Then  bring  the  team  back 
together  to  construa  the  composite 
process  flow  chart. 


Invite  non-team  members  to  review 
and  critique  the  process  flow  chart. 


It  is  often  useful  to  "Pareto, "  by 
category,  how  total  process  time  is 
consumed  by  a  process:  operations, 
delays,  movement,  inspection, 
decision-making,  and  filing. 
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6 


Identify  key  parameters  for  measuring 
customer  satisfaction;  establish  tai^ets 
for  improvement  whenever  possible. 


Hints 


Whidi  parameters  are  most  important 
to  the  external  customer? 


Example 


POSSIBLE  TARGETS:  Step  2  revealed  an  average  monthly  load 
of  20,000  samples.  A  2S%  increase  in  productivity  would  increase 
capacity  to  23,000;  a  level  encountered  during  peak  workloads.  If 
base  closings  double  the  workload,  a  mere  cycle  time  improvement 
of  20-50%  will  be  inadequate.  Most  importantly,  until  we  get  this 
process  under  statistical  control  we  don't  really  know  what  it  is 
capable  of  delivering. 


Which  process  steps  are  most  likely 
to  positively  it^luence  these  external, 
macr  j-measures  of  customer  satisfac¬ 
tion? 


Consider  these  possible  measures  of 
customer  satisfmion: 
cost 

on-time  delivery 

productivity 

safety 

tedmological  superiority 
cycle  time 


o 

§ 

a 

[Ih 


Chain 

of 

Custody 


Rapid 

Response 


False 


Key  Parameters  of 
Customer  Satisfaction 


CAUTION:  Ultimate  success  must  be  measured  in  customer 
terms.  Make  sure  the  parameters  you  track  and  improve  are 
customer  driven,  not  Quality  Council  driven.  Customer  agendas 
are  usually  straightforward;  internal  agendas  can  become  distorted. 


Useful  Tools 


Hints 


Notes  &  Data 


Cm  the  Quality  Council  or  process 
owner  estinutte  how  much  process 
improvement  is  required  or  antici¬ 
pated? 


Have  you  reedistically  evaluated  this 
process  on  its  ability  to  meet  or 
exceed  key  parameters  of  interest  to 
the  customer? 


Should  your  team's  "target"  im¬ 
provement  goals  exceed  the 
customer's  expectations  rather  than 
just  meet  them? 
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/Identify  the  probable  causes  of,  or 
barriers  to,  process  improvement. 


Hints 


Example 


What  are  the  possible  causes 
leading  to  the  symptoms  identified  in 
Step  4? 


Using  the  Nominal  Group  Technique  the  Team  identified  the  four 
most  likely  causes  of  inadequate  "cycle  times”  in  each  of  four 
categories:  manpower,  methods,  machines  and  facilities.  The 
resulting  "cause  and  effect  diagram"  is  shown  below. 


It  might  help  to  rrfer  badcto  thefiow 
chart  in  Step  5  to  see  whidi  process 
steps  have  the  most  impac  on  the 
outcome  of  the  entire  process. 


Are  there  any  non-value  added  steps 
that  should  just  be  eliminate? 


CAUTION:  You  will  identify  ten  times  more  "probable  causes" 
than  you  can  ever  hope  to  investigate.  While  brainstorming  for 
ideas  go  for  quantity.  But  once  you  have  a  list  of  probable  causes, 
tap  the  knowledge  of  your  best  people  to  identify  the  one  or  two 
which  promise  the  greatest  potential  for  improvement.  In  short, 
you  can't  investigate  everything  so  choose  wisely  that  which  you 
will  study. 
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Useful  Tools 


Hints 


Notes  &  Data 


Make  sure  you  invite  non-team 
members  who  work  in  the  process 
constantly  to  offer  their  suggestions. 
Why  not  invite  them  to  brainstorm 
their  ideas  on  the  matter. 


If  a  given  process  step  is  on  the 
flow  duirt  because  the  step  is 
supposedly  required  by  policy  or 
regulation,  confirm  the  truth  or 
inaccuracy  of  such  a  requirement. 


Are  problems  arising  because  the 
process  is  unnecessarily  complex? 


8  Verify  root  causes  of  the  problem  with 
data. 


Hints 


Example 


ColUct  data  OH  the  probable  causes 
ident^ed  in  Step  7.  Does  your  team 
know  enough  about  variation  and 
measurment  to  detect  a  root  cause 
in  a  data  set  if  its  there? 


HYPOTHESIS:  One  possible  cause  of  long  cycle  times  is  the 
detection  of  a  "positive"  in  a  "lot"  of  samples  firom  a  customer. 
We  want  to  test  the  hypothesis  that  the  presence  of  a  "positive" 
result  increases  the  time  required  to  process  the  "lot"  containing 
said  "positive."  The  following  30  "lots"  of  data  were  tabulated  to 
test  this  possible  "cause  and  effect"  relationship. 


WU  senior  management  be 
convinced  that  a  root  cause  has  been 
identified  if  they  review  your  data 
and  method  analysis? 


One  or  More  Positives  Per  “Lot" 
Yes  No 
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Once  root  causes  have  been 
verified,  does  team  membership  need 
to  be  dumged  in  the  interest  of  team 
^ectiveness? 


The  calculated  Chi-square  value  of  17.9  exceeds  the  critical  value 
of  3.84  at  95%  confidence:  the  presence  of  one  or  more  "posi¬ 
tives"  in  a  "lot"  has  a  definite  effect  on  total  processing  time  for 
said  lot. 


CAUTION:  Three  points!  Avoid  making  decisions  on  main 
causes  by  voting.  Voting  is  a  democratic  process  but  it  may  lead  to 
incorrect  conclusions.  Secondly,  have  some  number  crunching 
skill  on  your  team;  you'll  need  it.  But  most  importantly,  once 
you've  identified  a  root  cause  consider  carefully  how  you  are 
going  to  flx  it? 
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Useful  Tools 


Hints 


Notes  &  Data 


How  would  you  know  if  someone  was 
providing  the  team  "false'  data  out 
of  fear,  ignorance  or  malice?  How 
could  you  request  data  in  a  less 
threatening  or  invasive  way? 


In  the  process  of  verifying  root 
causes  have  you  uncovered  addi¬ 
tional  root  causes?  Are  they 
significant  enough  to  pursue?  Does 
the  rest  of  the  team  know  of  them? 


Ask  non-team  members  what  kinds  of 
data  they  would  collect  to  verify  a 
given  root  cause. 
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9  Identify  and  prioritize  possible  solutions; 


Hints 


Example 


Have  you  asked  the  person  who 
initialfy  proposed  the  cause  and  ^ect 
relationship  if  they  have  a  possible 
solution? 


ISSUE:  A  "positive"  during  drug  testing  of  a  "lot"  of  samples 
increases  processing  time.  How  can  we  eliminate  the  delays 
caused  by  "positives?" 


Use  ’divergent’  thinking  to  ensure 
the  team  looks  at  a  mmdter  of 
alternatives,  not  just  the  first  solution 
diat  comes  to  mind. 


Ask  non-team  members  who  aaually 
do  the  work  what  they  might  propose. 


CAUTION:  The  major  concern  here  is  similar  to  the  "caution" 
given  in  Step  7;  you  will  probably  have  more  possible  solutions 
than  you  could  ever  test.  So  pick  carefully.  If  you  are  careless 
you  might  work  on  a  solution  that  yields  a  10%  improvement  while 
one  of  the  "untested"  solutions  is  capable  of  1,000%  improvement. 
And  you’ll  never  know  how  close  you  really  were. 
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Useful  Tools 


Hints 


Notes  &  Data 


As  in  Step  7,  search  for  solutions  in 
the  areas  of  manpower,  machines, 
materials  ,  facilities,  methods.,  etc. 


Consider  using  the  pairwise-ranking 
approach  to  seleaing  among  alterna¬ 
tives  if  your  choices  are  few. 


What  does  the  process  owner  suggest 
in  the  way  of  solutions?  How  about 
the  Quality  Council? 


Develop  and  implement  solution(s)  on 
a  small  scale. 


Hints 


Example 


Rtcogiiiz0  tht  differenee  between 
aeptudcen  to  cure  the  symptoms 
(reworking  a  d^lea)  and  actions 
taken  to  eliminate  the  causal  factors 
improving  the  process). 


The  team  decides  to  implement  the  plan  outlined  below.  The 
purpose  of  the  test  is  to  determine  if  drug  testing  cycle  time  can  be 
reduced  significantly  by  reporting  results  on  "positives”  sqMuately 
from  the  bulk  of  the  "n^atives"  in  a  given  "lot.” 


Where/how  can  you  conduct  a  trial 
du  imposed  solution  that  will  have 
minimal  impact  on  other  players  in 
the  process? 


Many  times  there  are  multiple, 
interdependent  causes  for  a  given 
^ect.  Before  accumulating  iiforma- 
tion  try  to  design  a  data  collection 
strategy  that  will  unambiguously 
align  solutions  with  causes  and 
causes  with  ^ects. 


Activity 

Select  Air  Force 
Test  Site 

Select  Marine 

Test  Site 

Advise  Customer 
Of  Test 

Set  Test  Dates 

Collect  Data 

Analyze  Data 

Improvement  ? 

Report  Results 

To  Council 

Report  Findings 

To  Customers 

: 

; 

: 

: 

XL 

■ 

CAUTION:  Is  the  implementation  plan  robust  enough  to  prevent 
the  occurrence  of  the  Hawthorne  effect;  spurious  improvements 
because  people  are  being  watched? 
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Useful  Tools 

IB 

PERT 

Chart 

,.-V— , 

Critical 

Path 

Method 

■  \  . 

Hints 


Notes  &  Data 


As  you  prepare  an  implementation 
plan  to  test  the  merits  of  your 
proposed  solution,  ask  the  *5  Why's 
and  1  How*  to  clearly  specify  who 
will  do  what,  where,  when,  why  and 
how.  Produce  a  schedule  of  key 
milestones. 


If  multiple  solutions  are  to  be  tested 
at  the  same  time,  schedule  them  in 
such  a  way  that  you  can  tell  which 
actions  produce  results  and  which  do 
not. 


During  implementation,  check  to 
make  sure  the  plan  unfolds  as  sched¬ 
uled.  If  it  doesn 't,  find  out  what  has 
changed  and  take  corrective  action  as 
required. 
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U  Evaluate  and  confirm  improvement  to 
the  process. 


Hints 


Example 


Did  the  results  meet  the  targets 
initialfy  set  for  improving  this 
process? 


The  Team  executes  the  plan  outlined  in  the  previous  step,  and 
observes  the  following  results. 


Was  die  purpose  of  this  activity  to 
influence  the  process  average, 
reduce  process  variability,  or  both? 
Which,  if  any.  occurred? 


What  intangible  benefits  resulted 
from  this  process  improvement 
activity? 


10 


Lot  # 


20 


30 


XmR  Chart  For  Drug  Testing  Cycle  Time 


CAUTION:  Everyone  perceives  improvement  in  their  own  relative 
terms.  Make  sure  that  your  external  customer  believes  any 
"claimed"  improvement  is  real  and  significant.  It  doesn't  really 
matter  what  the  Quality  Council  or  process  owner  think  about  the 
extent  of  improvement;  perception  is  reality  to  the  customer. 
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Useful  Tools 


Hints _ Notes  &  Data 

How  well  was  the  plan  executed? 

What  would  you  do  differently  next 
time? 


Can  you  document  the  benefits  of  this 
action  in  dollars  &  cents,  increased 
quality,  improved  safety,  etc? 


What  did  the  team  learn  about  the 
process  of  continuous  improvement? 
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Standardize  the  process  improve¬ 
ments. 


Hints 


Example 


Whttt  does  the  new  process  look  like?  The  following  flow  chart  is  the  revised  drug  testing  process  which 

d^  it  differ  from  Inflow  improvements  confirmed  in  Step  11. 

chart  developed  m  St^  5? 


bis  the  endurance  of  the  improved 
results  diet  makes  them  meaningful. 
Haw  are  you  going  to  ensure  the 
improvements  last? 


♦  ♦ 


How  and  when  will  all  employees 
qffeaed  by  these  process  duuiges  be 
trained  in  the  new  way  of  doing  their 
jobs? 


CAUTION:  Change  is  always  difficult,  especially  when  it  affects 
us  personally.  No  matter  how  grpat  you  think  this  improvement  is, 
the  workers  whose  lives  are  affected  by  it,  but  who  were  not  on  the 
Team,  probably  do  not  see  it  as  positively  as  you  do.  Help  them 
to  understand  what's  in  it  for  them. 
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Useful  Tools 


Hints  Notes  &  Data 


Do  ail  of  the  major  stakeholders  like 
your  proposed  process  changes? 
Don 't  standardize  a  process  change 
that  is  offensive  to  any  stakeholders; 
especially  the  external  customer. 


Do  you  intend  to  collect  data  on  the 
new  process  to  ensure  it  doesn  't 
degrade?  How  often  will  you  check? 
Who  will  collect  and  analyze  the 
data?  How  long  will  you  continue  to 
monitor  it? 


Have  you  considered  empowering  the 
workers  to  track  the  indicators  and 
record  the  data  necessary  to  keep  the 
process  "in  control?’ 
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Celebrate  team  success  !!! 


Hints 


Has  the  Team  created  a  story  board 
that  captures  the  essence  of  their 
success  in  simple,  grt^c,  data- 


Example 


based  terms? 


Has  the  Team  been  given  the  oppor¬ 
tunity  to  expl/un  their  success  to  the 
senior  leadership  of  the  Laboratory, 
Product  Center,  or  Command? 


What  form  of  concrete,  physical 
recognition  will  team  members  be 
able  to  lotdc  at  a  year  from  now  to 
remember  their  success  and  show  to 
others? 


CAUTION:  When  recognizing  teams,  there  is  a  tendency  to  want 
to  shake  hands,  say  "thanks,"  hand  out  tee-shirts  and  mugs,  and  get 
back  to  work.  Make  it  a  big  deal.  Celebrate  long  and  hard  in  as 
many  ways  as  you  know  how.  These  people  have  spent  a  better 
part  of  a  year  trying  to  improve  things.  They  deserve  it. 


64 


Useful  Tools 


Hints 


Notes  &  Data 


How  can  you  involve  the  families  and 
co-workers  of  the  Team  members  in 
the  celebration  aaivities? 


What  additional  TQL  training  can 
you  provide  select  Team  members  as 
a  form  of  recognition/reward? 


Is  there  some  way  in  which  the 
external  customer  can  participate  in 
celebrating  with  the  Team? 


Anticipate  and  plan  future  improve¬ 
ments. 


EQnts 


Example 


It  is  not  a  good  idea  to  focus  on  the 
same  aaivityfitr  too  long.  If  the 
original  time  limit  has  been  readied 
and  the  Team  has  not  yet  readied  its 
original  objectives,  consider  redefin¬ 
ing  the  scope  of  their  activities  to 
ensure  a  timely  condusion  of  their 
work 


Did  the  Team  uncover  any  systemic 
problems  that  might  be  plaguing 
other  groups?  Could  these  groins 
ben^  by  reviewing  who  this  Team 
learned? 


So  where  does  one  go  from  here? 


During  executive  bri^ngs  has  the 
Team  prodded  senior  management 
with  a  list  if  important  problems  yet 
to  be  addressed? 


CAUTION:  As  noted  previously,  there  are  problems  everywhere, 
large  and  small.  There  will  be  a  tendency  for  this  Team  to  want  to 
solve  the  other  problems  they've  discovered  during  their  journey. 

It  is  important  that  they  close  out  this  activity  completely  before 
•starting  another,  and  that  they  negotiate  permission  to  perform 
additional  "team*  work  with  the  Quality  Council.  Only  the  Quality 
Council  should  be  chartering  process  improvement  activities. 

Why?  Read  Step  1  again! 
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Useful  Tools 


Hints  Notes  &  Data 


How  do  you  intend  to  share  your 
"lessons  learned’  with  others? 


Team  members  have  learned  some 
valuable  lessons  during  this  activity. 
That  knowledge  is  too  important  to 
waste.  Maxinuze  its  value  by  ensur¬ 
ing  that  the  original  team  members 
work  on  different  teams  in  the  Juture. 
Don't  simply  rrform  the  old  team 
because  it  worked  welL 


Some  Team  members  may  need  a 
break  between  team  assignments  to 
catdi  their  breath.  You  cm  have 
too  much  of  a  good  thing. 


6' 


Attachment  2.1  -  Customer  Identification 


When  Prepared:  Ar  Jytical  Services  Customers  -  Aug  92 

FY92  Customers  by  Command  -  Oct  92 


Need/Purpose:  To  identify  the  customers  and  examine  their 

impact  on  our  organization 


How:  Analytical  Services  Customers 
FY92  Customers  by  Command 


Developed  through 
database  search. 
Designed  with  data 
management 
information 
system. 
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Attachment  2.2A  -  Tools  Used  to  Survey  Customers 


When  Prepared:  Environmental  Sample  Analysis 

Questionnaire  -  20  Nov  92 


Need/Purpose:  Team  needed  to  know  customer's  desires  of 

services  provided.  With  this  knowledge 
these  key  desire  areas  could  be  focused  on 
by  the  PIT  group. 

How:  Questionnaire  developed  with  guidance  from  Deputy 
Director  of  OE  Directorate. 
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DEPARTMENT  OF  THE  AIR  FORCE 

ANMMMONC  LABORATOnv  lArMCi 
BROOKS  AM  ronce  basc  tsxas 


(fJUU 


FROM*  AL/OE 

2402  £  DP. 

BROOKS  AFB  TX  78235-S114 


2  0  NOV  199? 


SOBJi  Environmental  Sample  Analysis  Questionnaire 
TOi  See  Distribution  List 

1.  Ne  previously  announced  a  Symposium  on  Environmental  Analytical 
Laboratory  Efficiency  will  be  held  30  Nov-2  Dec  92  at  Brooks  AFB  TX. 

Your  organization  has  been  identified  as  providng  analytical  services  for  a 
sector  of  the  Air  Force's  environirental  samples.  At  attachment  1  you  will 
find  a  copy  of  the  questionnaire.  Request  you  complete  and  telefax  to  us 
at  DSN  240-2025  by  27  Nov  92. 


2.  At  attachment  2  is  a  copy  of  the  draft  agenda,  some  minor  changes  may 
occur  between  now  and  the  symposium.  The  billeting  arrangements  must  be 
made  by  the  traveler  (see  atch  3);  transportation  will  be  provided  from  the 
hotdl  to  Brooks  AFB. 


ERIK  K.  VERMULEN 

Deputy  Director,  Occupational  and 
Environmental  Health  Directorate 


3  Atch 

1.  Questionnaire  (Laboratory) 

2 .  Agenda 

3.  Billeting/Transportation 
Information 
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QUESTIONNAIRE 


ENVIRONMENTAL  LABORATORY  WORKLOAD 

AND 

OPERATIONAL  COST  DATA 


PURPOSE  OF  QUESTIONNAIRE!  This  questionnaire  has  been  prepared  to 
gather  workload  and  operational  cost  data  on  Air  Force 
environmental  testing  laboratories.  These  data  are  required  to 
respond  to  a  Congressional  mandate  for  the  Department  of  Defense  to 
provide,  as  part  of  the  FYSA  Budget  Request,  "a  complete 
construction,  support  cost,  contractor  cost  and  personnel  breakout, 
by  component  and  installation,  of  all  spending  associated  with  the 
operation  and  maintenance  of  all  laboratories  with  current  or 
potential  environmental  analysis  capabilities.** 


POINT  or  CONTACT:  If  you  have  questions  pertaining  to  the 
information  being  sought  or  need  help  in  filling  out  this 
questionnaire,  call: 


DSN  Comm 
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QUESTIONNAIRE 


PART  X  -  OEHERAL  XNPORMATIOH 

1.  OFFICIAL  NAME  OF  LABORATORY* 


2.  OFFICE  SYMBOL/CODE* _ _ 

3.  NAME  or  LABORATORY  POINTS  OF  CONTACT* 

LABORATORY  DIRECTOR _ 

QUALITY  ASSURANCE  DIRECTOR _ 

4.  PHONE  NUMBER:  FAX  NUMBER: 

DSN  DSN 

COMM  COMM _ 

-5.  PARENT  ORGANIZATION  NAME,  OFFICE  SYMBOL  &  ADDRESS; 


6.  PARENT  COMMAND: _ _ 

7.  COMPLETE  MAILING/CORRESPONDENCE  ADDRESS: 


8.  SAMPLE  SHIPMENT  AND/OR  STREET  ADDRESS  (IF  DIFFERENT  FROM  MAILING 
ADDRESS) : 


PART  X  -  CEHERAL  INfORMATXOM  <continu«d) 


9«  YEAR  THAT  LABORATORY  BECAME  (OR  WILL  BECOME)  OPERATIONAL 
(for  environmental  testing):  _ _ 

10.  NUMBER  OF  LABORATORY  SHIFTS:  1  2  !“|  3 


11.  HOURS  OF  OPERATION:  1ST 

SHIFT 

AM  - 

PM 

2NO 

SHIFT 

PM  - 

PM 

3RD 

SHIFT 

PM  - 

AM 

12.  FACILITY  information: 

YEAR  constructed: _ 

YEAR  OF  LATEST  MODIFICATION/REHOVATION : _ 

FACILITY  SIZE:  (Only  include  fipace  used  for  or  in  support  of 
analytical  (direct  testing)  Mork  or  occupied  by  personnel 
directly  supporting  the  analytical  laboratory  mission. 

Include  the  following  areas:  chemical/material  storage  rooms; 
sample  receipt/storage  areas;  LIMS  data  control/computer  room; 
and  utility/heating/cooling  system  rooms;  hallways; 
restrooms;  personnel  break  areas.) 


TOTAL  FACILITY: 

ANALYTICAL  SPACE:  _ SQ  FT 

ADMINISTRATIVE/OFFICE  SPACE:  _ SQ  FT 


ENVIRONMENTAL  MISSION: 

ANALYTICAL  SPACE:  _ SQ  FT 

ADMINISTRATIVE/OFFICE  SPACE:  _ SQ  FT 


13.  LABORATORY  TEST  EQUIPMENT: 

Wliat  is  the  total  value  of  ALL  ACCOUNTABLE  equipment  used  to 
perform  (and  support)  the  laboratory  environmental  testing 

mission?  _ (Data  can  be  obtained  from 

the  Custodian  Authorization/Receipt  Products  List  (CA/CRL) ] 

What  is  the  total  value  of  ALL  CAPITAL  equipment  (items 
costing  $15,000  or  more)  used  to  perform  (and  support)  the 
laboratory  environmental  testing  mission?  __ 

(Data  can  be  obtained  from  the  Custodian  Authorization /Receipt 
Products  List  (CA/CRL)  ] 

Please  furnish  a  current  copy  of  your  CA/CRL  along  with  tlie 
completed  questionnaire. 
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pjuiT  IX  -  LABORATORY  MI88ZON/MORKLOAO  INFORMATION 

1.  What  is  the  ini88lon(8)  of  th«  analytical  laboratory?  Please 
cheek  all  appropriate  blocks. 

Medical  (Industrial  Ilyqiene/Occupational  Health) 

]  I  Medical  (Clinical) 

j  J  Environmental  Compliance  (SDWA/RCRA/TSCA/CWA/CAA,  etc.) 
;  }  Environmental  Restoration  (IRP/CERCLA) 

;  {  QA/QC  (Industrial  Processes) 

{  {  QA/QC  (Fuels/Lubes,  Propellants,  Chemicals) 

{  I*  Other: _ 

{  {  Other:__ _ 

2.  SAMPLE  WORKLOAD:  [A  “sampie**  is  defined  as  a  product, 
material,  or  substance  (either  natural  matrix  or  man¬ 
made)  submitted  to  a  laboratory  for  testing  and  identified  with 
a  unique  customer  (i.e.,  field)  control  number.  Multiple 
containers  of  the  same  matrix  which  are  submitted  to  comply 
with  the  containerization  and  preservation  requirements  of 
various  analytical  methods  DO  NOT  constitute  separate  ■•samples" 
for  the  purposes  of  this  tabulation,  even  when  assigned 
separate  laboratory  control  numbers.] 

TOTAL  NUMBER  OF  SAMPLES  RECEIVED  (ALL  MISSIONS): 

FY92  _ 

FY91  _ 

FY90  _ 

FY09  _ 

TOTAL  NUMBER  OF  ENVIRONMENTAL  COMPLIANCE  SAMPLES  RECEIVED: 

FY92  _ 

FY91  _ 

FY90 

FY89  _ 

TOTAL  NUMBER  OF  ENVIRONMENTAL  RESTORATION  SAMPLES  RECEIVED: 

FY92 

FY91 

FY90 

FY89 


78 


PART  2Z  -  UOIORATORX  MISSION/HORKLOAD  INFORMATIOH  (continued) 

3.  FY92  EMVIHONMENTAL  TEST/ANALYSIS  WORKLOAD:  (A  -teef  or 

’’analysis'*  is  dafined  as  a  laboratory  procedure  performed  in 
accordance  with  a  documented  analytical  method  for  the  purpose 
of  determining  specific  constituents  in  a  sample  or  the 
physical  and  chemical  properties  of  the  sample  (see  definition 
of  sample  above}] 

ENVIRONMENTAL  TEST  CATEGORY  NUMBER  OF  TESTS 

Physical  Properties  (Hater  &  Wastewater) 


Inorganic  Water  Quality,  Non-Metals 


Inorganic  Hater  Quality,  Metals 

General  Screening  Tests  for  Organics 
(Aggregate)  In  Water  &  Wastewater 

Organics  in  Water  &  Wastewater 


Radioactivity  in  Water 


Biological  Examination  of  Water 


Microbiological  Examination  of  Water 


Hazardous  Waste  Characterization,  Metals 

Hazardous  Waste  Characterization,  Organics 

Hazardous  Waste  Characterization, 
Radioactivity 

Hazardous  Waste  Characterization,  Physical 
Properties, Inorganics,  Miscellaneous 

Site  Characterization,  Metals 

Site  Characterization,  Organics 

Site  Characterization,  Radioactivity 

Site  Characterization,  Miscellaneous 

Asbestos 


TOTAL  NUMBER  OF  ENVIRONMENTAL  TESTS/ANALYSES 
PERFORMED  IN  Fy92: 
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PJUtT  SIX  -  PERSONNEL  INFORMATION 


1.  TOTAL  NUMBER  OF  LABORATORY  PERSONNEL  (ALL  MISSIONS): 

MILITARY: _  CIVILIAN: _ 

2.  TOTAL  NUMBER  OF  PERSONNEL  SUPPORTING  ENVIRONMENTAL  MISSION: 

MILITARY: _  CIVILIAN: _ 

3.  ORGANIZATIONAL  STRUCTURE  SUPPORTING  ENVIRONMENTAL  MISSION: 

A.  TOTAL  NUMBER  OF  SUPERVISORS: _ 

*  GRADE/RANK  NUMBER 


B.  TOTAL  NUMBER  OF  AUMINISTRATIVE/SUPPORT  PERSONNEL: 
GRADE/RANR  NUMBER 


C.  TOTAL  NUMBER  OF  DIRECT  LABORATORY  PERSONNEL: _ ** 

grade/rank  number 


**ONLY  INCLUDE  CHEMISTS/TECHNICIANS  WITH  "HANDS-ON" 
INVOLVEMENT  IN  ENVIRONMENTAL  ANALYSIS;  DO  NOT  INCLUDE  QUALITY 
ASSURANCE  PERSONNEL  IN  THIS  CATEGORY. 
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PAMT  111  ->  personnel  INFORMATIOM  (confcinu«d) 


3«  (continued) 

D.  TOTAL  NUMBER  OF  QUALITY  ASSURANCE  PERSONNELS 
GRADE/RANK  NUMBER 


E.  TOTAL  NUMBER  OF  OTHER  PERSONNEL  (IF  APPLICABLE): 


GRADE/RANK  NUMBER  BRIEF  STATEMENT  OF  DUTIES 


PAHT  IV  -  COST  or  UIBOMTORY  OPERATIONS 


1.  Within  which  Major  Force  Programs  (MFP)  do  your  laboratory 
testing  operations  fall?  List  all  applicable  MFPs  and  the 
percentage  of  total  laboratory  funding  applicable  to  each: 

MFP  % 


MFP  % 


MFP _  _ _ % 

Which  of  the  above  MFPs  covers  environmental  testing? 

2«  Provide  FY92  data  on  total  laboratory  expenditures  (all 

missions  and  all  MFPs)  for  the  following:  (Round  values  to  the 
nearest  $100j 


EXPENSE  CATEGORY  EEIC 

Materiala/Supplles  6XX 

Equipment  Maintenance/  569 

Repair 

Small  Equipment  Items  628 

'Jtilities 

Travel  (non-training)  40X 

Lab  Certification  Fees 
Overtime  Pay  391 

Petty  Cash  619 


Training  (course  fees  plus  travel) 
Other  _ 

Other i _ 

Other : _ 

TOTAL  FY92  EXPENDITURES  FOR 

LABORATORY  OPERATIONS 


DOLLARS  SPENT,  Fy92 

$ _ 

$ _ 

$ _ _ 

$ _ 

$, _ 

$ _ 

$ _ 

$ _ _ 

$ _ 

$ _ 

$ _ 

$ _ 

$ 
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PART  XV  -  COST  or  lABORATORT  OPERATIOHS  (continued) 


3.  Does  the  laboratory  directly  pay  (out  of  its  operational  fmidn) 
the  Permanent  Change  of  Station  (PCS)  expenses  associated  with 
moving  civilian  personnel  within  your  laboratory  organiration 
or  when  hiring  them  from  other  Air  Force  or  Federal  agencies  or 
from  the  private  sector? 

!  }  Yea  |~j  Ho 

If  above  answer  is  •’Yes,"  how  many  such  movements  or  hires 
typically  occur  (on  the  average)  each  year?  _ ■ 


4.  Does  the  laboratory  pay  (out  of  its  operational  budget) 

for  contractors  (or  contractor  personnel)  to  test  a  portion  of 
the  samples  received  in  the  laboratory?  DO  DOT  include  samples 
sent  to  a  contract  laboratory  where  analyses  are  paid  for  by 
the  customer  using  meclianisms  such  as  MiPRs. 

YES  |~{  NO 

Are  these  contractor  services  provided  on-sight  at  the 
government  laboratory  facility? 

•H'  'll* 

Vfhat  is  the  annual  cost  of  these  contract  services? 

$  _ . 

What  percentage  of  tlie  total  laboratory  workload  is  analyzed  by 
contract  or  contractor  personnel? 

% 


83 


PART  V  -  OTHER  INFORMATION 


1.  Please  llet  your  laboratory  certification 
REGULATORY  CERTIFYING 

PROGRAM^  _  fSQ^nOl _  _ CgRTIE 


* 


e.g.  Drinking  V7ater  (SDWA),  HPDES,  etc. 


Attachment  2.3A  -  Customer  Satisfaction  Data 


When  Prepared:  Key  parameters  for  measuring  customer 

satisfaction:  Dec  92 


Need/Purpose:  To  find  customer's  key  desires  on  our 

services  provided. 

How:  Team  discussed  customer  feedback  and  matrix 
prioritization  data,  listed  customer 
desires  in  order  of  priority.  Team  used  this 
valuable  information  in  zeroing  in  on  improvements 
that  would  satisfy  customers  the  most. 
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*CUSTOMER  SURVEY  AT  LAB  CONSOLIDATION  MEETING  30  NOV-2 
DEC  1992 


Attachment  2.4A  -  Flow  Chart  and  Study  of 

Analytical  Chemistry  Processing 
Steps  in  the  Laboratory 


When  Prepared:  June  1992 

How:  Dr  Cupello  and  Mr  Thomas  made  a  detailed  tour  of  the 
Division.  They  brainstormed  together  and 
came  up  with  the  flow  chart. 

From  actual  times  for  each  process  stored  in  the  Lab's 
Information  Management  System,  Box  and  Whisker 
Diagram  for  1  Jan  -  2  Jun  92  data  was  developed.  This 
showed  times  required  for  each  process  step. 

Analysis  times  were  also  stored  in  the  Laboratory 
Information  Management  System.  Each  analysis 
function,  1-11,  was  broken  down  and  plotted.  The  Box 
and  Whisker  Diagrams  show  analysis  turnaround  times. 

Make  Note  Of:  See  chart  for  functions  represented  by  1  -1 1 . 

SRF  is  short  for  Sample  Request  Forms. 
LAB/UX  is  Laboratory  Information 
Management  System. 
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PROCESS  STEPS 


.2  00 


O 

§  VO 
Ji,  m 
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Reporting  Verification  Mail 


2  Industrial  Hygiene 

3  GC/MS 

4  Pesticides 

5  Volatile  Organics 

6  Inorganics 

7  Bulk  Asbestos 

8  Air  Asbestos 

9  Air  Particulates 

10  Commercial  Products 

1 1  Haz/Tox 
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DAYS  ro  ACCOMPLISH 


Shipping  Log-in  Analysis  Reporting  verify  Mail 
Procedure  Procedure 

PROCESS  STEP 
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SHIPPING  IN-HOUSE  CONTRACT  RESULTS 

ANALYSES  ANALYSES 


Attachment  2.6  -  Evaluation  of  Process  Performance 


When  Prepared:  Control  Charts/Scatter  Diagrams  - 

Sep/Oct  92 


Need/Purpose:  By  looking  at  historical  performance 

records,  the  areas  of  "improvement 
opportunities"  will  become  evident 


How: 

Samples  Received:  Control  Charts  showed  two  year 

record  of  incoming  samples,  listing 
variances  and  yearly  means. 

Analysis  Turnaround  Times:  Control  Charts  were 

developed  for  functional 
analysis  areas,  showing 
variance  In  analysis 
times  and  overall  means. 

Scatter  Diagrams:  Used  to  compare  analysis  time  verus 

analyses  requested. 

Pareto  Chart:  Looked  at  top  workload  drivers  in  each 
analysis  function. 


These  charts  were  developed  by  team  members  from 
LAB/UX  data  and  discussed/analyzed  at  our  meetings. 
These  data  charts  helped  us  better  understand  the 
process  and  it's  problems. 
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OEA  WEEKLY  SAMPLES  RECEIUED  1991-1992 
All  Functions  Combined  (In-House) 
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LCL  0.00000 


OEA  WEEKLY  SAMPLES  RECEIUED  1991-1992 


OEA  WEEKLY  TURNAROUND  TINE 
Function  1;  Metals  (Total) 


6.42918 


OEA  NEEKLY  TURNAROUND  TINE 
Function  1:  Pesticides  (Total) 
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LCL  10.68025 
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ANAl  YSES/SAMPI 


TURNAROUND  TIME 


lD 
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(sAva)  jsdoti  ijivjo 


('SAVG)  NV3l'\|  OJ 

-r*  3rn^H’/V» 


PARETO  CHART  OF  ANALYSES  PERFORMED  BY  11  OEA  FUNCTIONS 

Jta  1992  thiu  Juoe  1992 
(lop  3  per  fuactioa) 


ftinction 

Lsf  tnalYKa 

total  M  for  function 

1.  HAZH'OX* 

lead 

1489 

chroDium 

1405 

cadiniuin 

1378 

45591 

2.  METALS 

lead 

6603 

copper 

2995 

chromium 

2686 

33861 

3.  PEsneroES 

aroclof  101^ 

2245 

aroclor  1232 

2244 

arocior  1242 

2244 

34958 

4.  AIR  ASBESTOS 

asbestos 

2550 

fiberglass 

2 

TEM  analysis 

1 

2553 

S.  BULK  ASBESTOS 

asbestos 

2033 

chrysolite  asbestos 

230 

amosite  asbestos 

85 

2362 

6.  INORGANICS 

oil  and  grease 

1900 

chem  oxygen  demand 

1047 

phenol 

1027 

lbi20 

7.  VOLATILE  ORGANICS  • 

1 .4-dichIorobenzeae 

1588 

chlorobenzene 

1510 

.1 .2-dichlorobenzeoe 

1498 

55971 

8.  AIR  PARTICULATES 

nuisance  partic. 

1021 

silica 

52 

carbon  black 

48 

1193 

9.  INDUSTRIAL  HYGIENE 

luphlhas 

848 

benzene 

647 

toluene 

599 

8152 

10.  COMMERCIAL  PRODUCTS 

nujor  componenls 

179 

carbon  dioxide 

52 

acetylene 

45 

767 

11.  GC/MS  * 

1 ,3-dicblorobenzene 

337 

1 ,2-dicbIorobenzeoo 

337 

1 ,4-dich)orobenzene 

337 

20693 

GRAND  TOTAL 

41262 

224221 

loo  3  «i  K  of  fen  tout 

9.4* 

36.3* 

19.3* 

100.  * 

99.4* 

21.9* 

8.2* 

94.0* 

25.7* 

36.0* 

_ 4.9* 

18.4* 


umpte  size  much  smaller  than  duirablo  using  only  lop  3  analysis  per  function 
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Attachment  3.1A  -  Tools  Used  To  Analyze  The 

Process 


When  Prepared:  Metals  Function  Flow  Chart-Oct/Nov  92 

Customer  Service  Flow  Chart-Oct/Nov  92 
Pesticide  Analysis  Flow  Chart-Jan  93 
Sample  Process  Flow  Chart-Jul  92 


Need/Purpose:  To  educate  team  members  on  processes 

being  studied  and  for  identification  of 
bottlenecks. 


How:  The  team  made  a  detailed  tour  of  these  functions.  The 
flow  charts  were  then  developed  by  utilizing  expertise 
from  the  functional  areas  being  studied  and  by  group 
brainstorming. 
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METALS  (Rev  13  Nov  92) 


Shelve  Samples. 


MaMSfiika*. 
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CONTRACT  LAB  RESULTS  (Rev  13  Nov  92 ) 
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Receive  ResUls 
(Lupe). 


Review  OEHD  #'s. 
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Final  Report  Printed. 


Ctarnist  Rtvim 


:uslomer  Receivci 
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I^OAJ 
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PROCESS  STEPS 


Reporting  Verification  Mail 


Attachment  3.2A  -  Process  Performance  Baseline 


When  Prepared:  Turnaround  Time  Control  Charts  - 

Sep/Oct  92 

Samples  Received  Control  Chart- 
Sep/Oct  92 

Need/Purpose:  To  establish  a  baseline  as  a  reference  point 

for  determining  process  improvement. 

How:  The  charts  were  developed  using  data  obtained  from 
the  Analytical  Services  Division  sample  database 


Make  Note  Of:  Charts  are  x  and  r 
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INHOUSE  TURN  AROUND  TINE 
FOR  SECTION  01  FOR  91 


LCL  -34.64027 


INHOUSE  TURN  AROUND  TINE 
FOR  SECTION  OT  FOR  91 


LCL  -58,11584 


INHOUSE  TURN  AROUND  TIME 
FOR  SECTION  OT  FOR  92 


LCL  -20.37604 


Attachment  3.3A  -  Identification  of  Potential  Areas 

for  Process  Improvement 


When  Prepared:  Fishbone  Diagram  -  Dec  92/Jan  93 

Laboratory  Visit  Findings-Feb  93 


Need/Purpose:  To  identify  all  factors  which  contribute  to 

overall  sample  turnaround  times. 


How:.  Developed  through  group  brainstorming  and  employing 
the  function  flowchart. 


Make  Note  Of:  (L)  Large  effect  on  turnaround  times 

(M)  Medium  effect  on  turnaround  times 
(S)  Small  effect  on  turnaround  times 

Visit  Commercial  Laboratory-DataChem  Inc.,  and  Governmental 
Occupational  Chemistry  Laboratory-OSHA  in  Salt  Lake  City 
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Number  of  Sarv  s  Received 


SAMPLES  RECEIVED  FOR  FUNCTION  11  SY  DAY 
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MATERIALS  PROCEDURES  SAMPLES 


POLICY  PERSONNEL  EQUIPMENT 


SWZCt  Trip  Findings  on  Salt  Xiaka  City  Visit  of  Data  Chon,  OSHA 

z.  somnxoaiiD  TZiast 

a.  TAT  Ood/Bxpoditor  on  spocial  problems 

b.  Drop  Unnecessary  Certifications 

c.  Cut-back  on  Quality  Assurance 

d.  Add  Penalties  to  contractor  Non-Performance 
o.  Establish  Target/Estimated  Completion  Dates 

f.  Multiple  Level  of  Approval? 

g.  Screening  Tests  in  Field? 

h.  Sample  Prep  Drives  Work,  Drives  Operation 
20/Organic  17/Znorganic-Per8onel  in  Prep 

i.  -Hit  List" 

j.  Break-up  Sampling  Number  System  Differently  to  Slant  TATs? 

k.  Individual  Function  Matrices 
m.  Coversheet  Signature  Idea 

ZZ.  ZJUWEATORY  AUTONATION: 

a.  Data  Chem  on  Same  Wavelength  in  Laboratory  Automation 
Approach 

b.  Bar  Coded  Refrigerators  to  Identify  Where  Samples  are 

c.  Different  Lab  Automation  Approach  Headed  by  ADPE  Person/ 
Coordinates  with  Chemist 

d.  AutoRefill  for  Argon/Nitrogen 

e.  Electronic  Data  Transfer  of  Results  to  their  Customers! 

f .  AutoFax 

g.  Centralised  Data  Collection/LAS  into  LABUX 

h.  Investigate  Lease  Equipment 

i.  Data  Chem  has  Unified  Data  System-Drives  more  Training 
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ZXl.  PEXSONIISLi 


a.  Surga  Capabilitles-Train  People  in  Other  Areas,  Pull  People 

to  Hhata  Heeded 

b.  OSHA-People  Going  TOY,  Need  it  Stress  relief /Reward 

e.  Data  Chem  had  In-House  Electronic  Repair  Service  Person 

d.  Flexible  training  Schedule 

e.  Separate  Long  term  Waste  Storage,  Separate  Group  to  Dispose 
of  Waste 

f.  ’’Bullpen”  Idea 

g.  5  X  More  Space,  3-4  x  Personnel  to  do  Same  Workload 

h.  Career  Ladder  Based  on  Evaluation/ED/Exp.  Salary 
According/Keeps  People 

1.  Samples  Receiving  for  Start-up,  Education  Driven  Program, 

2  year  after  program  -  paid  well,  zero  turn  over  of 

X>ersonel 

j.  Flex  Piffle  at  OSHA.  Can  work  10-12  hrs/day 

k.  Double  Shift  in  Practice 

l.  Seven  Days  a  Week  Pperation 

m.  Inorganic/Organic  Sample  Prep  Areas 

n.  Hon-Compliance/Problem  Samples  Handled  By  loading  Dock 
People 

ZV.  COORDINATION: 

a.  OSHA  Had  On-Call  Contracts! 

b.  Chemists/Technicians  Went  to  Get  their  own  Samples 

c.  Don't  Perform  Non-Profit  Type  Work 

d.  Control  Charts  Displayed 

e.  POC  Contact 

f.  Have  Productive  Weekly  Meetings 
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V.  9Vt 


«.  V*ry  Interested  in  our  PIT  Approach-Forecasting  Workload 

b.  All  Refrigerators  Locked 

c.  Data  Chem-Creative  Space  utilization 

d.  Individual  Vents  for  Instruments 

e.  Hot  HNO  Wash  of  Glassware/Stored  Glassware  with  D-H  O 

f.  Established  a  Voucher  System 

g.  List  of  Responsibility  of  Analysts  -  Posted  which 
Motivates  People 
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Attachment  3.3B  -  Determination  of  Most  Significant 

Improvement  Opportunities 


When  Prepared:  Interrelationship  Digraph  -  Feb  93 


Need/Purpose:  After  identifying  areas  for  improvement,  the 

diagraph  was  used  to  zero  in  on  areas 
which  would  have  the  biggest  Impact  on  the 
overall  process. 


How:  .The  digraph  was  developed  via  group  brainstorming. 


Make  Note  Of:  Lack  of  automation,  personnel  experience 

and  lack  of  coordination  impact  the 
analysis  areas  over  which  the  PIT  has 
some  control. 
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Attachment  3.5  -  Final  Statement  of  the  Process  to 

Be  Improved 


When  Prepared:  Recommendation  of  PIT  Team  -  Feb  93 

Need/Purpose:  To  keep  staff  informed  on  PIT  group 

progress  and  findings. 

How:  Letter  issued  by  Division  Chief  to  Branch  Chiefs.  The 
Branch  Chiefs  held  meetings  to  inform  the  analysts 
of  the  PIT  approaches. 


4 


DEPARTMENT  OF  THE  AIR  FORCE 

AAMSTRONC  L>8ORAT0f)V  cArMCl 
BROOKS  AIR  FORCE  BASE  TEXAS 


noMt 

PIT  Team 

SOBJt 

Recoasaendation  of  PIT  Team 

TOt 

AL/OEA 

2402  B  Drive 

Brooks  AFB  TX  78235-5114 

Thm  PIT  Group  will  r«ro  in  on  the  following  areas  in  order  to 
character  of  decreasing  analysis  turnaround  timet 

a.  Lack  of  customer  coordination 


b.  La/pk  of  needed  automation 


✓ 


e''.  Lack  of  personnel  experience 


TBOMAS  C.  THOMAS,  GM~IS 

Chief,  Analytical  Services  Division 


1993 


improve  our  quality 
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Attachment  3.6A  -  Tools  Used  in  Root  Cause 

Analysis 

When  Prepared:  March-April  1993 

Need/Purpose:  Root  causes  of  major  problems  had  to 

be  identified  and  verified.  If  root  causes  can 
be  fixed,  major  problems  will  be.solved  and 
the  process  improved. 

How: 

Tree  Diagrams  -  The  PIT  group  broke  into  sub-groups 

and  came  up  with  ideas  for  tree 
diagrams.  PIT  group  then  met  and 
brainstormed  final  diagrams. 


Make  Note  Of:  Tree  Diagrams  -  3  Charts 
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WINTAIN  POSITION  PRQMOTABII 
PROVIDE  RECOGNITION/REWAROS 


Attachment  4.3  -  Team  Action  Plans 


When  Prepared:  Direct  Data  Transfer  for  Metals  -  Apr  93 

Electronic  Mailing  of  Results  -  Mar  93 
Implementation  of  Coversheet  -  Mar  93 


Need/Purpose:  To  establish  a  schedule  for  implementing 

process  improvements  selected  by  the 
team. 

How:  Interfaced  with  personnel  who  would  be  involved  in  the 
implementation  to  determine  time  required  for  each 
facit  of  the  proposed  improvements. 

Rating  of  Root  Causes  -  Matrix  diagraming  and 

rating  was  accomplished  by 
the  PIT  Group  to  Identify  key 
root  causes.  The  group  to 
voted  comparing  root  causes 
versus  criteria,  with  majority 
vote  ruling 
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DIRECT  DATA  TRANSFER  FOR  METALS 

20  April  1993 


PC  PORTION 

imm 

13  Apr  -  Down  loading  of  data  from 

1 3  Apr  -  Design  started  for  upload 

instrument  started. 

program. 

20  Apr  -  Data  Transfer  from 

20  Apr  -  23  Apr  -  Resolve  upload 

instrument  to  PC  and  edit 

parameters. 

capability  complete.  Review 

time  line. 

21  Apr  -  ILt  Wheeler  tests  upload 

program  for  user  friendliness 

22  Apr  -  Start  programming  QC 

features 

27  Apr  -  QC  programs  complete 

28  Apr  -  Test  QC  portion 

29  Apr  •  Program  upload  portion 

4  May  -  Upload  portion  complete 

5  May  -  Start  testing  complete  system 

1 1  May  -  System  in  operation 

1 2  May  -  Fine  tune  system 

June  -  Start  Manual  Entry 

Mid-June  -  Evaluate  Manual  Entry 

July  -  Implement  in  other  locations  in 
lab 
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IMPLEMENTATION  OF  ELECTRONIC  MAILING  OF  RESULTS 


29  March  93  -  Begin  initial  testing  of  electronic  nailing  of 
results. 

-  Four  test  bases  will  be:  Kelly,  Reese,  Vandenberg, 
Andrews . 

-  Begin  with  netal  section  only. 

-  Working  group:  Long,  Oakes,  Swartz 

19  April  93  -  Survey  test  bases  to  gauge  response  to  £~Mailing. 

3  May  93  -  End  of  initial  period  in  metals  function.  Group  to 
review  feedback. 

6  May  93  -  Begin  testing  in  multi-functional  areas:  pesticides, 
TCLP,  metals,  volatiles,  BC/MS  and  hazardous  waste. 

-  Add  two  bases,  Hahn  and  Robins. 

-  Add  a  **heads  up"  page  to  analytical  report  to  inform 
chemist  results  can  be  electronically  mailed. 

28  June  93  -  Survey  test  bases  and  chemist  to  gauge  how  E-Mail  of 
results  are  going. 

-  Entire  team  to  phone  bases 

26  July  93  -  End  of  test  period. 

-  Start  establishing  E-Mail  accounts  for  all  bases. 
Xmplementers:  Swartz,  Oakes 

Spring  94  -  Full  implementation  of  E-Mail  results  to  all  customers 
with  E-Mail  capability. 
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IMPLEMENTATION  OF  COVER  SHEET 


29  March  93  -  Start  report  cover  sheet  test  in  metals  sections. 
Working  group:  Long,  Jehl,  Oakes 

13  April  93  -  End  of  initial  test  period. 

Report  by  Long 

13  April  93  -  Begin  testing  of  report  cover  letters  lab  wide. 
Implementation  group:  Jehl,  Wiley,  Garland,  Long,  Oakes, 
function  and  branch  chiefs. 

13  May  93  ~  Test  period  concluded. 

Report  and  recommendations  by  same  group. 


154 


Attactawnt  "5. 


5S53355S2S3S32 


?x§3  333tiQ 

-§  ^  s  ^  s^«2.s.Ea 
•j  jg- 


9.  ^ 

2*  t- 

St.  ^ 

e  ?a 


^  *3 

s  II  ^ 

*-•5  8  5^ 

“■  ‘5’|  ^ 

^  -as  sa. 

•**  ^ 


SI  « 
•«  I  8  2> 

O  O  a  8 
JS 


^  ^  ^ 
^  &  s.  SA  se.  A  s. 

S  1  !!  !1  1  ^  f- 


!2!2!S!S!2!2S& 

slS.si.slslil<& 

^^^ata^aiaia; 

y».  «^.  v/».  w  >/>  ^ 


st5:.5:.se.*wStS.s. 


5  5  55552f! 

!d>  »s  si  !&  ti  IS  ^  w 


-  11  5 

?  li  f 

5  1  J  a 

«  S  9 

oe  J  - 


nasajssss 

sisi.slsi.slsi^^ 

8S88S8SS 


M  ^  S9«M 

^  w  3  w  w  a* 

303099900 


114 

*i  4  £ 


»  J 

J  I 


4  4 


I  8  i  a  ^  ^ 

«9  iS  o  H  2 


AI.|iUksr«ir|irojccls  fur  AL project  work  ($.00)0.20  (4.00)1.41  (SA0)110  (3.00)0.09  (1.00)014  ($.00)0.05 

DUseiiiinoic  workload  for  AF  Rep  luMlinct  (4.00)0.l(  (3.00)1.01  (4.00)0.90  (5.00)0.15  (1.00)014  (3.00)0.03 

Vlluw  It^sc  lilm  ks  for  projects  for  A F  Regs  kaselinn  (l.00)0.U  (3.00)1.01  (4.00)0.90  (5.00)0.15  (1.00)014  (3.00)0.03 

i\»p.iiuic  schedule  fur  AF  iir.g$  kascliiics  (3.00)0.12  (3.00)1.01  (4.00)0.90  (5.00)0.15  (1.00)014  (3.00)0.03 

Alkiw  lUs,-  l.liNiks  fur  projects  fur  Ai.  project  (5.00)010  (4.00)1.41  (4.00)0.90  (3.00)0.09  (110)014  ($.00)0.05 


SOLUTION  RATING  FOR  LAB  AUTOMATION  IMPROVEMENTS  IN  METALS 
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START  A  CUSTOMER  SERVICE  STATUS  LINE 
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Rating  Returns  for  Improving  Personnel  Experience 

Provide  for  Workstations  Rotations  -  3.89- 

Establish  &  Validate  Training  Objectives  -  3.18 

Work  with  Civ  Personnel  Departments  to  Improve  Retention  -  3.10 

Identify  Key  Military  Personnel  -  2.99 

Request  HAJCOM  to  Reinstate  Control  Tours  -  2.86 

Allow  Flex  Time  for  Education  -  2.78 

Increase  Opportini ties  for  In  House/TDY  Training  -  2.73 
Provide  Recognition/Rewards  for  Personnel  -  2.44 
Offer  Incentives/Rewards  for  Education  -  2.30 
Advertise  Current  Programs  for  Tutoring/Other  Ed.  -  2.01 
Help  Determine  Appropriate  Course  Levels  -  1.76 
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Attachment  6.3  -  Metrics  Used  on  an  On-Going  Basis 

To  Ensure  Continuous  Process 
Improvement 


When  Prepared;  April  -  August  1993 

IMeed/Purpose;  Process  control  and  management  metrics 

utilized  to  monitors  results  and 
insure  continuous  process  improvement. 


How:  Performance  charts  to  monitor  analysis  turnaround 
« 

times,  customer  service,  and  capacity. 

Sample  suspense  and  sample  suspense  management 
lists  are  to  ensure  better  turnaround  times  were  being 
achieved- 
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Attachatnt  6 


ANALYTICAL  SERVICES  DIVISION  PAGE  1 

SAMPLE  SUSPENSE  LIST 
WORKCSNTER:  10900  GC/MS  ANALYSES 
DATB/TIME:  12-Aug-93  16:20:22 


OEA 

RECEIVED 

SUSPENSE 

CURRENT 

CALL 

SAMPLE  # 

PRIORITY 

DATE 

DATE 

STATUS  CONTRACTOR 

NXmBER 

93036696 

9 

930720 

930810 

Tests  Requested 

93035798 

9 

930715 

930819 

Tests  Requested 

RABA 

361493 

93035799 

9 

930715 

930819 

Tests  Requested 

RABA 

361493 

93035871 

9 

930715 

930819 

Valid  Complete 

RABA 

363093 

93035874 

9 

930715 

930819 

Valid  Complete 

RABA 

363093 

93036213 

9 

930715 

930819 

Valid  Complete 

CLAY 

361693 

93036214 

9 

930715 

930819 

Valid  Complete 

CLAY 

361693 

93038353 

9 

930730 

930820 

T^sts  Requested 

93036697 

9 

930720 

930824 

Valid  Complete 

RABA 

362593 

93036701 

9 

930720 

930824 

Valid  Complete 

RABA 

362593 

93036723 

9 

930720 

930824 

V8lid  Complete 

RABA 

362393 

93036724 

9 

930720 

930824 

Valid  Complete 

RABA 

362393 

93036866 

9 

930721 

930825 

Valid  Complete 

RABA 

363193 

93036867 

9 

930721 

930825 

valid  Complete 

RABA 

363193 

93036868 

9 

930721 

930825 

Valid  Complete 

RABA 

363193 

93036869 

9 

930721 

930825 

Valid  Complete 

RABA 

363193 

93037003 

9 

930722 

930826 

Valid  Complete 

RABA 

363293 

93037004 

9 

930722 

930826 

Valid  Complete 

RABA 

363293 

93037017 

9 

930722 

930826 

Valid  Complete 

RABA 

363293 

93037018 

9 

930722 

930826 

Valid  Complete 

RABA 

363293 
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PCN:  OEA0002  ANALYTICAL  SERVICES  DIVISION 

SAMPLE  SUSPENSE  MANAGEMENT  LIST 
SAMPLES  WHOSE  MAIL  DATE  EXCEEDED  THE  SUSPENSE  DATE 
DATE/TIME:  30-Aug-93  08:35:44 

FUNCTION:  02  Pesticide  Function 

FUNCTION  CHIEF:  Mr.  Dennis  Mark 


OEA 

RECEIVED 

SUSPENSE 

MAIL 

CONTRACT 

CONTRACT 

SAMPLE  # 

DATE 

DATE 

DATE 

LAB 

CALL  NUMBER 

93033801 

930706 

930727 

930805 

93033802 

930706 

930727 

930805 

93033803 

930706 

930727 

930805 

93033804 

930706 

930727 

930805 

93033805 

930706 

930727 

930805 

93033806 

930706 

930727 

930805 

93033807 

930706 

930727 

930805 

93034728 

930709 

930813 

930818 

RABA 

360093 

93034729 

930709 

930813 

930818 

RABA 

360093 

93034730 

930709 

930813 

930818 

RABA 

360093 

93034731 

930709 

930813 

930818 

RABA 

360093 

93034732 

930709 

930813 

930818 

RABA 

360093 

93034733 

930709 

930813 

930818 

RABA 

360093 

93034734 

930709 

930730 

930801 

93036039 

930716 

930820 

930826 

RABA 

362093 

93036040 

930716 

930820 

930826 

RABA 

362093 

93036041 

930716 

930820 

930826 

RABA 

362093 

93036042 

930716 

930820 

930826 

RABA 

362093 

93036043 

930716 

930820 

930826 

RABA 

362093 

93036044 

930716 

930820 

930826 

RABA 

362093 

93036045 

930716 

930820 

930826 

RABA 

362093 

93036046 

930716 

930820 

930826 

RABA 

362093 

93036717 

930720 

930824 

930825 

RABA 

362693 

93036718 

930720 

930824 

930825 

RABA 

362693 

93036719 

930720 

930824 

930825 

RABA 

362693 

93036720 

930720 

930824 

930825 

RABA 

362693 

93036721 

930720 

930824 

930825 

RABA 

362693 

93036722 

930720 

930824 

930825 

RABA 

362693 

93038215 

930729 

930819 

930830 

93038216 

930729 

930819 

930830 

93038543 

930802 

930823 

930826 

TOTAL  SAMPLES  WITH  EXCEEDED  SUSPENSES:  31 
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Attachment  7.2C  -  Benefits  of  the  Team  and  Lession 

Lf^arned  Communicated  to  Other 
Teams,  Management,  and  the 
Rest  of  the  Organization 


When  Prepared;  Storyboard  -  Feb  93 

AL  Newsletter  -  Spring  93 
OE  Newsletter  Article  -  Fall  92 
Customer  Satisfaction  Survey  - 
Apr-Aug  93 

Customer  Feedback  on  Electronic  Mailing  - 
Apr  93 

Cover  Letter  Explanation  -  Apr-May  93 


Need/Purpose:  To  communicate  existence  of  AL/OEA  PIT, 

it's  progress  and  improvements,  and  to 
help  later  TQ  teams  in  their  efforts. 


How;  Storyboard  -  Combine  Team  Effort 

AL/Newsletter  -  Prepared  by  PIT  facilialtor 
OE  Newsletter  -  Article  written  by  team  effort 
Customer  Satisfaction  Survey  -  Developed  by  Team 
Cover  Letter  Explanation  -  Developed  by  Team  effort 
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EXTRA,  EXTRA 


PIT  STORYBOARD  SETUP  IN 
ARMSTRONG  LABORATORY 
HEADQUARTERS  LOBBY 


OUAj  ITY 

.  JL^aboratory  — " 


Commentary 


In  this  first  QUALITY  AIR 
FORCE  newsletter  I  would  like 
to  share  with  you  some  of  the 
important  strides  we  have  made 
within  the  Laboratory  segment 
of  the  HSC  community  to 
promote  quality.  Unfortunately, 
or  more  correctly— fortunately, 
much  of  what  has  taken  place  is 
not  yet  visible  at  the  "working 
level"  within  the  Laboratory. 

As  I  stated  to  you  in  my  Jan 
92  letter  distributed  inside  the 
TQL  DICTIONARY,  "My 
initial  efforts  will  he  focused  on 
getting  senior  management  to 
understand  the  important  role 
we  must  play  in  the  TQL  pro¬ 
cess,  and  the  behavioral 
changes  uv  must  make  as  a 
leadership  team  if  TQL  is  to 
survive. "  Much  of  the  Total 
Quality  emphasis  is  still  focused 
on  the  top  of  the  organization 
where  it  is  needed. 

Our  Total  Quality  efforts 
could  be  more  visible  at  the 
•working"  level  where  research, 
consultation,  and  teaching  take 
place  if  we  could  speed  up  the 
rate  of  "cultural"  change  in  our 
organization.  Cultural  change 
takes  time,  however,  and  if  you 
push  too  hard  things  can  break. 


We  certainly  have  enough 
change  taking  place  today  to 
keep  all  of  us  busy,  but  not 
all  of  it  is  cultural-type 
change. 

Some  valuable  and  inter¬ 
esting  things  have  been 
happening  within  the  last  12 
months.  Td  like  to  review 
just  a  few  of  them  with  you. 


■  monthly  nadings  on  'quality* 
are  distributed  to  the  top  250 
leaders  within  HSC; 

■  a  30  page  TQL  DICTIONARY 
was  distributed  to  all  AL  personnel; 

■  a  32  page  TEAM  HAND¬ 
BOOK  was  created  for  use  by  AL 
Teams; 

■  an  AL  Quality  Council  has  been 
formed  and  although  it  has  not  been 
meeting  regularly  to  date,  it  will 
starting  this  Fall; 

■  a  full-tinK  TQL  Advisor 
position  was  created,  reporting  to 
the  Laboratory  Director  and 
supporting  the  Quality  Council's 
activities; 

B  Two  PIT  Teams  have  been 
Chartered  by  the  Quality  Council, 
have  received  PIT  Team  training 
and  are  meeting  regularly; 

B  A  large  conference  room  in 
Building  125  has  btren  identified 
and  reserved  for  PIT  Team  use; 

B  Over  $15,000  worth  of  >sx>ks, 
videos  and  audiovisual  equipment 
was  purchased  for  placement  in  the 
dedicated  PIT  Team  room: 


B  6  AL  Facilitators  have  been 
trained,  and  4  of  them  are  spending 
20%  of  their  time  in  AL-specific 
TQL  activities; 

B  a  4-hour  TQL  'ax^areness 
seminar"  has  been  developed  for 
Armstrong  Laboratory  personnel  and 
will  be  available  this  Fall; 

B  The  Quality  Council  has  visited  a 
worldclass  R&D-based  company,  the 
Dow  Chemical  Company,  to  review 
their  Total  Quality  efforts; 

B  The  Quality  Council  has  attended 
two,  day-long  executive  seminars  on 
Total  Quality,  and  more  are  sched¬ 
uled  in  the  future; 

B  $100,000  was  budgeted  to  support 
AL  Total  Quality  efforts  in  FY92  and 
FY93; 


There  are  many  other 
things  I  could  mention  as  well. 
But  let  me  close  on  this  note. 
As  the  Director  of  this  Labora¬ 
tory  I  have  not  been  able  to 
[see  "Commentary"  page  4"] 


Fall  1992  _ Brooks  Air  Force  Base,  Texas  78235  ■  1 
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ANALYTICAL  SERVICES  (OEA)  PIT  TEAM 
CHARTERED  BY  DR  WELCH 


Teams  have  existed  on 
Brooks  AFB  for  as  long  as  the 
base  has  existed.  But  in 
August  of  1992  two  very 
special  Teams  were  formed, 
one  in  OEA  and  the  other  in 
AOT.  More  about  the  AOT 
Team  in  the  next  issue  of 
QUALITY  AF.  What 
makes  these  Teams  so 
special?  What  is 
special  is  the  way  in 
which  th^  are  being 
selected,  trained  and 
nurtured. 

First,  a  short 
history  lesson.  In  Jan 
1992  General  Ander¬ 
son  sent  a  letter  to  the 
Laboratory  explaining 
his  vision  for  HSC  to 
be  "a  leader  in  envi¬ 
ronmental  restoration, 
protection  and  com¬ 
pliance."  Shortly 
thereafter,  HSC  Vice 
Commander  Klein 
sent  Dr  Welch  a  letter 
applauding  the  proud 
history  of  OE,  and  encourag¬ 
ing  us  to  find  ways  to  shorten 
OEA  "response  times"  in  order 
to  capture  the  62%  of  Air 
Force  environmental  samples 
currently  being  analyzed 
elsewhere.  In  May  of  1992  Dr 
Welch  directed  the  Laboratory 
Total  Quality  Advisor  (AL/ 
TQ)  to  establish  a  PIT  Team  in 
both  OEA  and  AOT. 

During  the  months  of  June 
and  July,  three  facilitators  (Dr 
Cupello,  Dr  Murphy  and  Cpt 


Engquist)  started  meeting 
regubrly  with  Mr  Tom  Tho¬ 
mas,  the  OEA  Division  Chief, 
to  more  clearly  define  what 
this  Team  should  accomplish. 

A  preliminary  look  at  the 
way  environmental  samples 
are  processed  revealed  that  the 


"analysis"  step  was  the  most 
time  consuming. 

In  early  August  Mr  Tho¬ 
mas  identified  nine  individuals 
to  serve  on  the  OEA  PIT 
Team,  including  an  internal 
customer  (OEB)  and  function 
chiefs  heading  three  of  the  1 1 
analytical  functions:  metals, 
pesticides  and  hazardous/toxic 
materials. 

During  the  week  of  24 
August  the  AOT  and  OEA  PIT 
Teams  received  four  days  of 


1 


o 


training  in  group  dynamics  and 
quality  tools.  This  intensive 
course  was  offered  by  Change 
Navigators  out  of  Colorado. 

The  Team  has  been  meet¬ 
ing  for  90  minutes  every 
Tuesday  morning  since  then. 
They  are  following  a  14-step 
method  for 
process 
improvement. 
To  date  they 
have  devel¬ 
oped  a  mis¬ 
sion  state¬ 
ment,  ana¬ 
lyzed  over  40 
control  charts 
worth  of 
"capacity" 
and  "turn¬ 
around  time" 
data,  and 
have  just 
recently 
begun  flow 
charting  the 
work  pro¬ 
cesses  for  met¬ 
als,  pesticides,  haz/tox  and 
customer  service. 

Dr  Jim  Cupello,  the  Team 
Facilitator,  has  commented,  7 
have  never  met  a  more  posi¬ 
tive.  enthusiastic,  hard  work¬ 
ing,  aggressive  Team  as  this 
one.  When  they  are  finished 
with  this  assignment,  everyone 
will  be  able  to  tell  the  differ¬ 
ence  in  OEA.  Everyone!  But 
management  must  have  the 
courage  to  make  the  changes 
the  Team  recommends. ' 


J 
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Tom  Thomas 
Team  Leader 


TSgl  Dan  Thompson 


Cpi  Tim  Wiley 


C<*jnine!iiary 


qiend  as  modi  time  as  I  would 
like  on  Total  Quality  efforts 
widun  tte  Laboiarory.  The 
DOD  environment  is  changing 
so  rapidly  that  a  great  deal  of  RIGHT  EVERY  TIME:  USING  THE  DEMING  APPROACH 

my  time  is  spent  on  survival  by  Frank  Price.  A  Review  by  Lt  Col  Bob  Cartledge,  AL/OEDL 

issues;  I  must  deal  with  that  Dr  W.  Deming’s  strength  is  his  weakness.  He  articulates  a 

which  is  urgent,  not  necessar-  profound  philosophical  landscape  of  quality  management  but 
ily  what  is  important.  Some-  provides  little  insight  as  to  how  to  till  the  garden  and  when  to 
times  it  is  impossible  to  tell  plant  the  crops.  Frank  Price,  in  his  book,  fills  the  role  of  the 
which  is  which.  county  agricultural  agent,  translating  what  the  professor  said  into 

Burt  Nanus,  an  acknowl-  a  language  we  can  understand, 
edged  expert  on  leadership,  Mr  Price  begins  his  book  with  an  extraordinary  introductory 

summed  it  up  this  way:  chapter  about  organizational  cultures.  If  nothing  else,  get  the 

”...  w6y  is  leadership  book  just  to  read  the  first  chapter.  Cultures,  per  Mr  Price,  are 

inadequate?  The  answer  is  like  mountains,  each  with  di^erent  perspectives  on  the  organiza- 

that  the  prevailing  wisdom  tions.  Cultures,  which  range  from  "please  the  boss"  to  "please 
about  leadership  has  become  yourself"  are  oiganizational  glues.  Mr  Price  skillfully  argues 
dangerously  unbalanced.  that  the  glue  ought  to  be  Quality. 

Leadership  is  seen  as  primarily  RIGHT  EVERY  TIMF  is  organized  around  Deming’s  four- 
...  concerned  with  the  relation-  teen  points.  Unlike  many  other  authors,  Mr  Price  groups  simi- 
ship  between  the  leader  and  lar  points  into  a  single  chapter.  This  approach  helps  to  put  the 
the  follower  or  organization  ...  Fourteen  Points  into  unifying  themes  and  to  simplify,  somewhat. 

The  conditions  cfthe  new  age  the  Quality  implementation  process.  The  book  employs  a  wide 
demand  at  least  as  much  cross-section  of  examples  to  enlighten  the  reader  about  Quality. 

attention  to  the  ever-changing  These  examples  range  from  a  discussion  of  training  and  educa- 
external  environment  as  to  the  tion  in  the  early  days  of  medicine  to  the  purchase  of  nails  to 

internal  or  organizational  shoe  horses  in  the  U.S.  Cavalry.  In  other  words,  don’t  expect 

envirotanent. "  an  endless  litany  of  examples  of  1980’s  business  failures  and 

I  can  promise  you  two  turnarounds,  illustrating  how  TQM  will  save  the  American 

things  relative  to  the  future  of  economy.  Mr  Price  cultivates  his  Quality  garden  with  a  unique 
TQL  within  the  Armstrong  blend  of  insight,  humor,  history,  and  wisdom. 

Laboratory.  I  will  make  every  Mr  Price  believes  in  Deming  so  much,  that  the  praise  some- 
effort  to  get  the  Quality  Coun-  times  becomes  a  little  too  thick.  But  don’t  let  that  dissuade  you 

dl  meeting  on  a  regular  basis  from  digging  into  Mr  Price’s  words, 

to  (fiscoss  "quality,"  and  I  will  I  don’t  know  how  many  non-believers  will  see  the  Quality 

also  begin  the  process  of  light  after  reading  this  book.  But  if  you  are  curious  about 

pushing  the  quality  effort  Deming,  RIGHT  EVERY  TIME  should  be  in  your  TQM  li- 

down  into  the  organization  by  brary.  In  fact,  the  book  does  such  a  good  job  expressing  Dr 
emphasizing  the  creation  of  Deming’s  philosophy  that  I  recommend  reading  it  before  Dr 
Directorate-level  Quality  Deming’s  OUT  OF  THE  CRISIS. 

Coundls  and  PIT  Teams  at  t^e  [Two  copies  of  this  book  are  available  in  the  AL/TQ  office; 

earliest  opportunity.  [Dr  Billy  contact  Dr  Cupello  (4-2091)  for  1  week  checkout.  The  book  war 
E.  Welch]-  originally  published  by  Marcel  Dekkcr,  Inc.  for  $65  and  may 

still  be  available  from  that  source] 
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BASE:  OLAC-PL-UEST^SEH 
BASE  CODE:  0097U 
SAMPLE  NUMBER:  97040014 


DATE:  930902 
DIUISION:  OEA 


ARMSTRONG  LABORATORY  CUSTOMER  SATISFACTION  SURUEY 

This  survey  helps  us  improve  our  service  to  you.  Your  confiden¬ 
tial  answers  will  significantly  impact  on  how  we  allocate  re¬ 
sources  to  meet  your  needs.  Please  return  it  promptly.  Thank 
you  1 

PLEASE  CIRCLE  YOUR  RESPONSES  BELOU  USING  THE  FOLLOUING  SCALE: 


1 

2 

3 

4 

5 

6 

Extresely 

Dissatisfied 

Slightly 

Slightly 

Satisfied 

Extreaely 

Dissatisfied 

OissatisMed 

Satisfied 

Satisfied 

1.  Timeliness:  Did  you  receive  your  results  123496 

within  published  time  limits? 

2.  Accuracy:  Is  the  report  in  the  proper  for-  123456 

mat?  Are  the  address  and  other  data  correct? 


3.  Content:  Does  the  report  answer  your  ques-  123456 
tions  and  provide  the  necessary  data? 

4.  Customer  Support:  Have  we  been  courteous  and  123456 
helpful  in  meeting  your  special  needs  (priority 

service',  reporting  format,  etc.)? 


5.  Consultation  Service:  Have  we  answered  your  123456 
questions  and  provided  necessary  materials  or 

reviews  to  support  your  mission  requirements? 

6.  Overall  Rating:  Do  you  enjoy  doing  business  123456 
with  us?  Uould  you  recommend  us  to  others? 


7.  Suggestions:  Are  there  other  services  that  you  would  like 
us  to  provide  in  the  future?  tPlease  list  them  below.) 

COMMENTS:  (Use  the  back  of  this  form  if  more  space  is  required) 


RETURN  TO:  Armstrong  Laboratory/  OEPQ 
2404  E  Drive 

Brooks  AFB.  TX  78235-5114 
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From  daaiBon  Tua  rtpr  27  07*16  CDT  19?3 

Raeaivadt  froM  HTr-ANCWSUS.madnet.af .mil  by  hadpl .brooks . af .mi  1  with  SMTP 

- rai7^7*?lpr-93“07ri2Ta|Q-CST -  - - - - 

Raeaivadt  by  MTF-AHOREUS.mednet .af .mi I  (9.99/29-eef ) 

- ^J"?W(Rf3Y2 ;  TuaT'g^'l^r  '95  TreT(B7?y~Etn 

flaaaage-Idt  <9304271206. AA02362gnTF-ANOREUS. medna t  .aF. mi  1> 

agbeaivegr-f rom  smt^VT  iBl~2BDD2r78:F03  . . 

S  (UordPerFect  SMTP  Gateway  U3.1a  04/27/^92) 

RacoIvaaT-Tro!s"HTF^?aTOREBS - lQP~ConnSETlon) . 

9leceivodt  from  MGMC5  ’  <UP  Connect  ion) _ _  _  _ 

From*  ^cbfne jyHTF-ANUREUS.mednet .af .mi 1>  TCorneli  JeFfrey) 

To:  <Bhsdpl.  brooks,  af  .mi  1 :  oakesgl'abux. brooks  .  aF  .mi  1> 

SuBTicCT-lNoTBub-TecTJ — (SriTF“iail-lTr“  RSpl^" 

Date:  Tue  Apr  27  08:05:12  1993 


Lab  results  received  in  good  order  on  26  Apr  93. 


nU/OEA 
2402  E  ORIUE 

BROOKS  AFB,  TEXAS,  78235-5114 


In  an  effort  to  impros^e  our  support  for  you,  we  are  testing  a  new 
cover  letter  for  sending  results.  This  procedure  will  contribute  to 
shorter  analytical  turn  around  times.  If  your  office  has  comments 
on  this  new  procedure  or  any  questions  concerning  analytical  results 
or  methods,  please  let  us  Know  in  the  Analytical  Services  Division  at 
DSN  240-3626,  commercial  210  536-3626,  or  via  electronic  mail  at 
'*ecs@oeh  1  is . brooks  .  a f  .  mi  1  “  . 

/ 

Enclosed  you  will  find  laboratory  reports  for  the  following  samples: 


BASE 

AL/OE 

BASE 

AL/OE 

BASE 

AL/OE 

SAMPLE  ♦ 

SAMPLE  ♦ 

SAMPLE  ♦ 

SAMPLE  ♦ 

SAMPLE  ♦ 

SAMPLE  ♦ 

CS930517 

93040014 

CS9305ia 

93040015 

CS930519 

93040016 

CS930520  93040017 


Reviewed  by:  _ 

Thomas  C.  Thomas 

Chief,  Analytical  Services  Division 


TO:  OLAC-PL-UJEST/StH 

EDUARDS  AKB,  CA  93523-5000 
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